- Original Article
- Open Access
A clinical–radiomics model based on noncontrast computed tomography to predict hemorrhagic transformation after stroke by machine learning: a multicenter study
Insights into Imaging volume 14, Article number: 52 (2023)
To build a clinical–radiomics model based on noncontrast computed tomography images to identify the risk of hemorrhagic transformation (HT) in patients with acute ischemic stroke (AIS) following intravenous thrombolysis (IVT).
Materials and methods
A total of 517 consecutive patients with AIS were screened for inclusion. Datasets from six hospitals were randomly divided into a training cohort and an internal cohort with an 8:2 ratio. The dataset of the seventh hospital was used for an independent external verification. The best dimensionality reduction method to choose features and the best machine learning (ML) algorithm to develop a model were selected. Then, the clinical, radiomics and clinical–radiomics models were developed. Finally, the performance of the models was measured using the area under the receiver operating characteristic curve (AUC).
Of 517 from seven hospitals, 249 (48%) had HT. The best method for choosing features was recursive feature elimination, and the best ML algorithm to build models was extreme gradient boosting. In distinguishing patients with HT, the AUC of the clinical model was 0.898 (95% CI 0.873–0.921) in the internal validation cohort, and 0.911 (95% CI 0.891–0.928) in the external validation cohort; the AUC of radiomics model was 0.922 (95% CI 0.896–0.941) and 0.883 (95% CI 0.851–0.902), while the AUC of clinical–radiomics model was 0.950 (95% CI 0.925–0.967) and 0.942 (95% CI 0.927–0.958) respectively.
The proposed clinical–radiomics model is a dependable approach that could provide risk assessment of HT for patients who receive IVT after stroke.
Noncontrast computed tomography (NCCT) is valuable for predicting hemorrhagic transformation (HT) after intravenous thrombolysis (IVT) treatment.
Machine learning is vital for predicting HT.
NCCT radiomics integrated with clinical factors could facilitate predicting HT.
Acute ischemic stroke (AIS), which has significant death and disability rates, poses a serious threat to human life . The rapid intravenous delivery of recombinant tissue type plasminogen activator remains the main method for the early management of AIS in selected individuals .
Patients with stroke undergoing intravenous thrombolysis (IVT) are at risk of developing hemorrhagic transformation (HT) . Between 10 and 48% of patients who receive thrombolytic therapy develop HT . In cases of HT following thrombolysis, the prognosis is worse, regardless of whether the condition is symptomatic hemorrhagic transformation or not. This could also affect subsequent treatment. Moreover, with the trend of extending the time window further, it is important to detect HT development earlier and more precisely. Therefore, stroke neurologists can take proactive measures to prevent clinical deterioration and make optimal treatment decisions if HT is predicted early.
At present, various methods can be used to predict HT, for example, clinical indicators [5,6,7], imaging data [8,9,10,11,12,13,14] or combination of clinical features and imaging markers . However, some previous studies involved fewer predictors, and the effectiveness of the prediction model was relatively limited (AUC < 0.75). Moreover, some studies have applied magnetic resonance imaging (MRI), which is time-consuming. In addition, because computed tomography perfusion examinations generated much more radiation and were expensive, they cannot be performed in smaller medical centers. Nevertheless, noncontrast computed tomography (NCCT) images were chosen as the study’s source images because they are more frequently performed, take less time, and, most importantly, are recommended by the guidelines for AIS . NCCT images, particularly for thick images with slice thickness of 5 mm and slice spacing of 5 mm, are also much more practical for reexamination.
Radiomics analysis, a new method for assisting precision medicine, can automatically extract radiomics features from medical images, which is anticipated to overcome the shortcomings of visual image evaluation [16, 17]. According to previous studies, NCCT-based radiomics features have superior abilities in various disciplines. Regarding stroke, several problems have been reported, such as prediction of hemorrhage expansion after spontaneous intracerebral hemorrhage [18, 19], early identification of ischemic stroke  and estimating infarction onset time . However, the method of obtaining radiomics features based on NCCT has not been utilized for the prediction of HT risk following thrombolysis, which is the primary focus of the present study.
Numerous machine learning (ML)-related studies have emerged in recent years, and ML undeniably performs quite well in classification and prediction . At present, stroke-related ML research has been reported, and its performance is very outstanding . Some studies have found that the method of predicting HT by ML is feasible [24, 25]. In this study, we developed and validated ML algorithms to automatically predict HT in patients with AIS receiving IVT combining clinical and radiomics-based features.
Materials and methods
This multicenter retrospective analysis was approved by the institutional review boards of our hospital, and the necessity for patient informed consent was waived.
Clinical data and NCCT images were collected from seven hospitals from June 2012 to December 2021. A total of 822 consecutive patients with AIS were chosen for inclusion. This study included patients with AIS who met the following criteria: (1) were undergoing IVT in accordance with the management guidelines for AIS, (2) had completed NCCT examination before IVT therapy, and (3) underwent a follow-up MRI or NCCT within 36 h after receiving IVT. Patients with head trauma injuries, primary cerebral hemorrhage or brain tumors, hemorrhagic infarction upon admission, insufficient data, and severe artifacts on NCCT images were excluded.
Finally, a total of 517 patients (282 patients without HT and 235 patients with HT) were enrolled. The dataset from six hospitals (the First Affiliated Hospital of Chongqing Medical University, Chongqing General Hospital, Haikou Affiliated Hospital of Central South University Xiangya School of Medicine, the Second People’s Hospital of Hunan Province/Brain Hospital of Hunan Province, the First Affiliated Hospital of Hainan Medical University, Changsha Central Hospital (the Affiliated Changsha Central Hospital, Hengyang Medical School, University of South China)) was randomly divided into training cohort (n = 355) and internal validation cohort (n = 90). Data from the seventh hospital (People's Hospital of Yubei District of Chongqing City), which included 33 patients with HT and 39 patients without HT, were kept as an independent external validation cohort. The flowchart of patients’ preparation is depicted in Fig. 1.
Obtaining clinical data
Clinical data (demographic data and laboratory tests) were obtained. Laboratory tests on admission (including blood pressure, blood glucose levels, and blood lipid levels), initial National Institute of Health Stroke Scale (NIHSS) score, onset-to-CT time, medical history (including smoking (smoking index), drinking (drinking index), previous stroke, diabetes mellitus, and atrial fibrillation) and Trial of ORG 10172 in acute stroke treatment (TOAST) typing of acute stroke etiology were examined separately from the electronic medical record system.
Additional file 1: Table S1 presents the models of CT scanners and scanning parameters used in seven institutions (Additional file).
HT was determined based on the European Co-operative Acute Stroke Study-II trial . CT images show high-density lesions, including hemorrhagic infarction (HI) and parenchymal hemorrhage (PH). In this study, two neuroradiology staff members independently evaluated HT on follow-up NCCT or MRI within 36 h following IVT therapy for all the training and testing datasets without knowledge of the patient outcome (X.H. and L.B.Y., directors with 10 years of experience in neuroradiology). Any discrepancy was resolved by consensus. By comparing prior CT or MRI images, HT and contrast agent extravasation could be differentiated, and the conclusion was supported by examination performed 2–7 days following treatment.
Clinical data were processed using Z-score normalization after missing values were filled in using K-nearest neighbor (KNN). Furthermore, the steps of NCCT image normalization were as follows: (a) every NCCT image slice was resampled to a unified pixel dimension size of 1.0 × 1.0 × 1.0 mm3; (b) image intensity of every NCCT image was normalized by the gray-level discretization method with a fixed number of bins (256 bins); The purpose of the two steps was to minimize any potential effects brought on by scanners, scanning parameters. In addition, NCCT images were set in a fixed head window (window level = 50 Hounsfield unit (Hu); window width = 110 Hu). The purpose was to ensure there was less difference while manually drawing lesions.
The region of interest (ROI) of cerebral infarction was manually defined on the axial slices of NCCT images using the 3D-Slicer software, slice by slice, around its perimeter. If the lesion’s border was not clearly visible on the NCCT image, diffusion-weighted images taken within 6 h were used to draw the border.
To ensure the reproducibility of radiomics features, the intra- and interobserver correlation coefficients were computed using the ROIs randomly selected from 20 patients. By comparing the ROIs’ features of radiologists 1, the intraclass correlation coefficient (ICC) was determined (twice, one month apart). Comparing the ROIs’ features of radiologists 1 and 2 allowed for the calculation of the inter-ICC. The features (with both ICCs threshold ≥ 0.95) having good reliability were added to the subsequent analysis (Additional file 1: Figure S1).
By applying the mask of ROIs, radiomics features were extracted based on the 3D-Slicer package (Version no. 4.13.0) (https://www.slicer.org/). Eight categories of radiomics features were obtained as follows: first order; shape; shape 2D; gray-level co-occurrence matrix (GLCM); gray-level run length matrix (GLRLM); gray-level size zone matrix (GLSZM); neighboring gray-tone difference matrix and gray-level dependence matrix.
Finding the best method to select features
Firstly, for clinical data, T-test was used to test the characteristics of significant difference between HT group and non-HT group in the training cohort. Then we compared the five common dimensionality reduction methods (including Least Absolute Shrinkage and Selection Operator (LASSO), Select from Model, Recursive Feature Elimination Cross Validation (RFECV), Recursive Feature Elimination (RFE), and Logistic Regression (LR)) by ten-fold cross validation in the training cohort to choose the best one. And the best method was used to select the most important clinical features (the blue part of Fig. 2).
Secondly, for radiomics features, the unrepeatable features below the ICC threshold were eliminated from the 1037 radiomics features obtained after sketching, leaving 778 features. The best of the five popular methods (LASSO, Linear Support Vector Classification, RFECV, RFE, Tree-based Model) was chosen by ten-fold cross validation in the training cohort to select the most significant radiomics features (the red part of Fig. 2).
Finding the best ML algorithm to build models
Before modeling, the effects of five ML algorithms (eXtreme Gradient Boosting (XGB), Support Vector Machine, LR, Stochastic Gradient Descent, and random forest) were compared to identify the best algorithm by ten-fold cross validation in the training cohort (the yellow part of Table 4) to develop the prediction model of HT.
Independent clinical prediction factors (p < 0.05) for HT were obtained by the best dimensionality reduction method mentioned above (Fig. 2). Then, they were used to develop a clinical model by the best ML algorithm. And the model was used in the internal and external validation cohorts to test the efficiency.
Using the same process as developing the clinical model, a radiomics model was constructed in the training cohort utilizing the most significant radiomics features which were ultimately selected. In addition, the internal and external validation cohorts also need to verify the radiomics model.
Finally, the clinical–radiomics model, which combined distinct clinical risk variables and important radiomics features, was developed in the training cohort and then validated independently in the internal and external validation cohorts.
To assess each model’s performance, the receiver operating characteristic curve was created, and the AUC was calculated.
The calibration curve was presented to assess the model’s capacity for calibration, which compares the consistency between real results and the clinical–radiomics model. To assess the combined model’s clinical utility, a decision curve analysis (DCA) was used. The workflow of the radiomics analysis of the ROI and the building model is described in Fig. 3.
All statistical data were analyzed using R software (version 4.1.3) (https://www.r-project.org/). Normal data were presented as means ± standard deviation, and qualitative data were shown as numbers and percentages. A chi-squared test, a two-sample t-test, or the Mann–Whitney U test was used to evaluate the clinical characteristics. To compare the AUCs of various models, the DeLong test was utilized. A two-sided p value < 0.05 was deemed significant for all statistical analyses.
Patients’ clinical characteristics
This study comprised 517 individuals (333 male [64.4%], mean age ± standard deviation 67.02 ± 12.67) from seven hospitals. The clinical data of all patients are shown in Table 1.
Outcomes of screening features
According to Tables 2 and 3, the RFE is the best method to select features for clinical and radiomics data. This study found that XGB had the highest accuracy and AUC (Table 4).
The result of the univariate analysis for clinical risk factors associated with HT in the training cohort is presented in Table 5. After RFE, five independent risk factors were selected, including baseline NIHSS (0.379), fibrin degradation products (FDPs) (0.183), monocyte (0.147), D-dimer (0.164), and N-terminal pro-brain natriuretic peptide (NT-proBNP) (0.128) (the number reflects the importance of each feature).
In all cases, 778 radiomics features were reduced to avoid model overfitting by RFE. Then, 12 radiomics features were selected for building radiomics model (Fig. 4).
Performances of the clinical and radiomics models
The AUCs were calculated to assess the performance of the three models.
The clinical model demonstrated an AUC of 0.996 (95% CI 0.991–0.999) in the training cohort, 0.898 (95% CI 0.873–0.921) in the internal validation cohort, and 0.911 (95% CI 0.891–0.928) in the external validation cohort for differentiating patients with HT (Fig. 5, Table 6).
In the training cohort, the radiomics model displayed an AUC of 0.999 (95% CI 0.999–1.000); internal validation cohort, 0.922 (95% CI 0.896–0.941); and external validation cohort, 0.883 (95% CI 0.851–0.902) (Fig. 5, Table 6).
Performances of the clinical-radiomics model
In the training cohort, the AUC of this clinical–radiomics model was 0.995 (95%CI 0.991–0.999); in the internal validation cohort, it was 0.950 (95% CI 0.925–0.967), and in the external validation cohort, it was 0.942 (95% CI 0.927–0.958) (Fig. 5, Table 6). The DeLong test demonstrated no difference between the clinical model and the clinical–radiomics combination model in the training cohort, internal validation cohort or external validation cohort (p = 0.954, 0.179, and 0.364, respectively).
In the training cohort (p = 0.458) and internal validation cohort (p = 0.341), the clinical–radiomics model and the observed result had excellent agreement on the calibration curve for the potential of HT. However, the external validation cohort (p = 0.032) had slightly worse consistency (Fig. 6).
The decision analysis curves for all three models indicated that they were all clinically useful in predicting the HT (Fig. 7).
In this study, we developed an ML approach by incorporating clinical data with radiomics-based features from NCCT to predict the risk of HT postthrombolysis. It compensates for the limitations of visual recognition of NCCT image signs, reduces misdiagnosis and missed diagnosis by inexperienced first-line doctors, and increases their diagnostic confidence. By contrast, because these clinical data are obtained by routine examinations after admission, this model can be applied rapidly and is practical. In addition, we used data from multiple centers for modeling and independent external verification, so the model has a high degree of generalizability.
In this study, five clinical variables including NIHSS, FDPs, D-dimer, monocytes, and NT-proBNP on admission were found to be significant risk factors of HT for patients with AIS undergoing IVT. NIHSS is frequently used to measure the severity of a stroke, as it is effective for determining awareness and motor, sensation, response, and advanced nerve functioning . Previous studies have shown that NIHSS was an independent risk factor of postthrombolysis HT [28, 29], which is consistent with the finding of our study. This indicates the need to avoid thrombolytic therapy if a patient suffers from a serious stroke. A study demonstrated that the FDPs on admission were related to PH [6, 30] because FDPs might impede platelet aggregation by competing with fibrinogen for binding to the platelet membrane [31, 32]. D-dimers may cause monocytes to produce and release proinflammatory cytokines, such as interleukin-6 (IL-6) and IL-1β , which will augment the HT risk . These findings suggest that the coagulation index is very important for predicting HT, which needs the close attention of doctors. Finally, NT-proBNP is an inactive fragment derived from the cleavage of BNP . In line with earlier studies [36,37,38], our findings showed that NT-proBNP level was independently associated with HT in patients with stroke who had received IVT. One possible explanation was that HT exacerbated the brain damage caused by ischemic stroke . NT-proBNP needs to be distinguished from other disorders, such as heart failure; when its level increases, its sensitivity is great, but its specificity is weak. Thus, if a patient suffers from AIS, the doctor may recognize that the patient has a higher risk of HT.
The proposed clinical model could be utilized to estimate the HT risk and had excellent prediction efficiency. In this study, the AUC of the clinical model in the external validation was slightly greater than that in the internal validation, demonstrating a stronger capacity for generalization. Previous studies have only used clinical baseline data to predict HT , which is best suited for patients without access to imaging data. Since HT is primarily from the infarction itself and it is not sufficient to analyze merely clinical signs, we extracted the imaging characteristics of the ischemic area.
Then, the features extracted from NCCT images were used to develop the radiomics model, and the prediction efficiency was also great. In this study, 12 optimal quantitative radiomics features were extracted. Among them, the wavelet-HHH-glrlm-RunEntropy was the most important feature that mirrored the apparent heterogeneity of the infarction. The result might imply that the HT risk increases with the degree of heterogeneity of the infarct area. Nevertheless, further studies are required to elucidate the relationship between the pathological changes in HT and NCCT-based radiomics features. In addition, the shape features described the size of the cerebral infarction. The findings were similar to those of earlier studies  and revealed that the larger the infarct zone, the greater the HT risk. Consequently, although some signs on NCCT, such as the hyperdense middle cerebral arteries sign or the Alberta Stroke Program Early CT Score, can predict the risk of HT , front-line doctors may fail to recognize these signals because they lack experience, with which could be compensated by our radiomics-based models.
In this study, although DeLong's method yielded no statistical significance, it is noteworthy that AUC and accuracy were consistently higher in clinical-radiomics model than clinical model, across internal and external validation sets, showing the potential for radiomics to improve the prediction for future HT. In addition, the DCA results also revealed that the three models had a significant net benefit in predicting HT. As a result, if these models will be used as trustworthy, repeatable tools can guide therapeutic decisions. Moreover, they are less time-consuming—the model will actually identify the HT risk of a new patient within only a minute. Thus, this model may be used in clinical practice as soon as possible after being confirmed by a larger group.
This study has some limitations. First, because this was a retrospective study with a limited sample size, although participants from seven hospitals were included, some selection biases may have occurred. Moreover, because part of clinical data of some patients was incomplete, K-nearest neighbor method was used to fill in the missing values, which was the limitation of the study. After this study’s attempt, the NCCT-based model and clinically relevant data were quite efficient, which gave us more confidence to broaden the scope of our subsequent research. Later, despite studies on radiomics nowadays, including those on tumor, inflammation, and cerebrovascular illness, the model’s interpretation of radiomics features is generally limited or incomplete. Therefore, it is expected that subsequent research would gradually shed light on the internal link between radiomics features and clinical results. Furthermore, the intrinsic attribute of CT radiomics makes that most radiomic features are highly affected by CT acquisition and reconstruction settings , so we preprocessed all the NCCT images to reduce the impact of these factors. Thirdly, this study's reproducibility and viability may be limited by the fact that the ROI from post-IVT MRI was not feasible in a setting where only pre-IVT NCCT was administered. Fourthly, this article only predicts whether HT will occur, not including HT typing (HI and PH). Finally, some risk factors related to HT were not included, such as matrix metalloproteinases, homocysteine, and others, because some hospitals lacked the necessary laboratory indices. In actuality, many multicenter or big data research projects also struggle with this challenging issue. The integrity and consistency of the current data must be resolved because doctors in different institutions cannot agree on the same disease examination method and equipment, and patient’s compliance is different. As a result, more institutions must join the project of predicting HT, which calls for more alluring experts to organize them to do so. In the future, increasing their clinical practicability could help in integrating more clinical characteristics into the model and expand the number of samples.
By using radiomics features extracted from NCCT images and clinical features, this study established a model that demonstrated great performance and individualized risk assessment of HT for patients who received IVT. This trustworthy model can help first-line doctors identify patients who are at a significantly higher risk of HT and support them when they make clinical decisions.
Availability of data and materials
The datasets generated and/or analyzed during the current study are not publicly available because the subjects did not provide written consent for their data to be publicly shared.
Acute ischemic stroke
Area under the receiver operating characteristic curve
Blood urea nitrogen
Diastolic blood pressure
Decision curve analysis
Fibrin degradation products
Gray-level co-occurrence matrix
Gray-level run length matrix
Gray-level size zone matrix
Glycated hemoglobin A1c
High-density lipoprotein cholesterol
Intraclass correlation coefficient
International normalized ratio
Large artery atherosclerosis
Least absolute shrinkage and selection operator
Low-density lipoprotein cholesterol
- Linear SVC:
Linear support vector classification
Magnetic resonance imaging
Noncontrast computed tomography
National Institute of Health Stroke Scale
Negative predictive value
N-Terminal pro-brain natriuretic peptide
Positive predictive value
Recursive feature elimination
Recursive feature elimination cross validation
The region of interest
Systolic blood pressure
Stochastic gradient descent
Stroke of other determined etiology
Stroke of undetermined etiology
Support vector machine
Small vessel occlusion
Trial of ORG 10172 in acute stroke treatment
White blood cell
EXtreme gradient boosting
Pandian JD, Gall SL, Kate MP et al (2018) Prevention of stroke: a global perspective. Lancet 392:1269–1278. https://doi.org/10.1016/S0140-6736(18)31269-8
Powers WJ, Rabinstein AA, Ackerson T et al (2019) Guidelines for the early management of patients with acute ischemic stroke: 2019 update to the 2018 guidelines for the early management of acute ischemic stroke: a guideline for healthcare professionals from the American Heart Association/American Stroke Association. Stroke 50:e344–e418. https://doi.org/10.1161/STR.0000000000000211
Xing Y, Guo ZN, Yan S et al (2014) Increased globulin and its association with hemorrhagic transformation in patients receiving intra-arterial thrombolysis therapy. Neurosci Bull 30:469–476. https://doi.org/10.1007/s12264-013-1440-x
Emberson J, Lees KR, Lyden P et al (2014) Effect of treatment delay, age, and stroke severity on the effects of intravenous thrombolysis with alteplase for acute ischaemic stroke: a meta-analysis of individual patient data from randomised trials. Lancet 384:1929–1935. https://doi.org/10.1016/S0140-6736(14)60584-5
Wang Y, Cheng Y, Song Q et al (2020) The association between monocyte to high-density lipoprotein ratio and hemorrhagic transformation in patients with acute ischemic stroke. Aging 12:2498–2506. https://doi.org/10.18632/aging.102757
Liu C, Zhang Y, Niu L, Li J (2022) High level of the fibrin degradation products at admission predicts parenchymal hematoma and unfavorable outcome of ischemic stroke after intravenous thrombolysis. Front Neurol 12:797394. https://doi.org/10.3389/fneur.2021.797394
Saposnik G, Demchuk A, Tu JV et al (2013) The iScore predicts efficacy and risk of bleeding in the National Institute of Neurological disorders and Stroke Tissue Plasminogen Activator Stroke Trial. J Stroke Cerebrovasc Dis 22:876–882. https://doi.org/10.1016/j.jstrokecerebrovasdis.2012.09.001
Kim T, Koo J, Kim SH et al (2018) Blood-brain barrier permeability assessed by perfusion computed tomography predicts hemorrhagic transformation in acute reperfusion therapy. Neurol Sci 39:1579–1584. https://doi.org/10.1007/s10072-018-3468-1
El Nawar R, Yeung J, Labreuche J et al (2019) MRI-based predictors of hemorrhagic transformation in patients with stroke treated by intravenous thrombolysis. Front Neurol 10:897. https://doi.org/10.3389/fneur.2019.00897
Jain AR, Jain M, Kanthala AR et al (2013) Association of CT perfusion parameters with hemorrhagic transformation in acute ischemic stroke. AJNR Am J Neuroradiol 34:1895–1900. https://doi.org/10.3174/ajnr.A3502
Yassi N, Parsons MW, Christensen S et al (2013) Prediction of poststroke hemorrhagic transformation using computed tomography perfusion. Stroke 44:3039–3043. https://doi.org/10.1161/STROKEAHA.113.002396
Campbell BC, Christensen S, Butcher KS et al (2010) Regional very low cerebral blood volume predicts hemorrhagic transformation better than diffusion-weighted imaging volume and thresholded apparent diffusion coefficient in acute ischemic stroke. Stroke 41:82–88. https://doi.org/10.1161/STROKEAHA.109.562116
Oppenheim C, Samson Y, Dormont D et al (2002) DWI prediction of symptomatic hemorrhagic transformation in acute MCA infarct. J Neuroradiol 29:6–13
Shinoda N, Hori S, Mikami K et al (2017) Prediction of hemorrhagic transformation after acute thrombolysis following major artery occlusion using relative ADC ratio: a retrospective study. J Neuroradiol 44:361–366. https://doi.org/10.1016/j.neurad.2017.07.003
Mazya MV, Bovi P, Castillo J et al (2013) External validation of the SEDAN score for prediction of intracerebral hemorrhage in stroke thrombolysis. Stroke 44:1595–1600. https://doi.org/10.1161/STROKEAHA.113.000794
Lambin P, Rios-Velazquez E, Leijenaar R et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48:441–446. https://doi.org/10.1016/j.ejca.2011.11.036
Kumar V, Gu Y, Basu S et al (2012) Radiomics: the process and the challenges. Magn Reson Imaging 30:1234–1248. https://doi.org/10.1016/j.mri.2012.06.010
Chen Q, Zhu D, Liu J et al (2021) Clinical-radiomics nomogram for risk estimation of early hematoma expansion after acute intracerebral hemorrhage. Acad Radiol 28:307–317. https://doi.org/10.1016/j.acra.2020.02.021
Xu W, Ding Z, Shan Y et al (2020) A nomogram model of radiomics and satellite sign number as imaging predictor for intracranial hematoma expansion. Front Neurosci 14:491. https://doi.org/10.3389/fnins.2020.00491
Lin J, Li X, Wu G et al (2020) White matter high signals interfere with noncontrast computed tomography in the early identification of cerebral infarction. Cerebrovasc Dis 49:135–143. https://doi.org/10.1159/000505807
Wen X, Shu Z, Li Y et al (2021) Developing a model for estimating infarction onset time based on computed tomography radiomics in patients with acute middle cerebral artery occlusion. BMC Med Imaging 21:147. https://doi.org/10.1186/s12880-021-00678-1
Yu Y, Guo D, Lou M et al (2018) Prediction of hemorrhagic transformation severity in acute stroke from source perfusion MRI. IEEE Trans Biomed Eng 65:2058–2065. https://doi.org/10.1109/TBME.2017.2783241
Lee H, Lee EJ, Ham S et al (2020) Machine learning approach to identify stroke within 4.5 hours. Stroke 51:860–866. https://doi.org/10.1161/STROKEAHA.119.027611
Wang F, Huang Y, Xia Y et al (2020) Personalized risk prediction of symptomatic intracerebral hemorrhage after stroke thrombolysis using a machine-learning model. Ther Adv Neurol Disord 13:1756286420902358. https://doi.org/10.1177/1756286420902358
Bentley P, Ganesalingam J, Carlton Jones AL et al (2014) Prediction of stroke thrombolysis outcome using CT brain machine learning. NeuroImage Clin 4:635–640. https://doi.org/10.1016/j.nicl.2014.02.003
Hacke W, Kaste M, Fieschi C et al (1998) Randomised double-blind placebo-controlled trial of thrombolytic therapy with intravenous alteplase in acute ischaemic stroke (ECASS II). Second European-Australasian Acute Stroke Study Investigators. Lancet 352:1245–1251. https://doi.org/10.1016/s0140-6736(98)08020-9
Xu X, Li C, Wan T et al (2017) Risk factors for hemorrhagic transformation after intravenous thrombolysis in acute cerebral infarction: a retrospective single-center study. World Neurosurg 101:155–160. https://doi.org/10.1016/j.wneu.2017.01.091
Kidwell CS, Saver JL, Carneado J et al (2002) Predictors of hemorrhagic transformation in patients receiving intra-arterial thrombolysis. Stroke 33:717–724. https://doi.org/10.1161/hs0302.104110
Liu M, Pan Y, Zhou L et al (2017) Predictors of post-thrombolysis symptomatic intracranial hemorrhage in Chinese patients with acute ischemic stroke. PLoS One 12:e0184646. https://doi.org/10.1371/journal.pone.0184646
Trouillas P, Derex L, Philippeau F et al (2004) Early fibrinogen degradation coagulopathy is predictive of parenchymal hematomas in cerebral rt-PA thrombolysis: a study of 157 cases. Stroke 35:1323–1328. https://doi.org/10.1161/01.STR.0000126040.99024.cf
Sun X, Berthiller J, Trouillas P et al (2015) Early fibrinogen degradation coagulopathy: a predictive factor of parenchymal hematomas in cerebral rt-PA thrombolysis. J Neurol Sci 351:109–114. https://doi.org/10.1016/j.jns.2015.02.048
Verni CC, Davila A, Sims CA et al (2020) D-dimer and fibrin degradation products impair platelet signaling: plasma D-dimer is a predictor and mediator of platelet dysfunction during trauma. J Appl Lab Med 5:1253–1264. https://doi.org/10.1093/jalm/jfaa047
Jickling GC, Liu D, Stamova B et al (2014) Hemorrhagic transformation after ischemic stroke in animals and humans. J Cereb Blood Flow Metab 34:185–199. https://doi.org/10.1038/jcbfm.2013.203
Liberale L, Montecucco F, Bonaventura A et al (2017) Monocyte count at onset predicts poststroke outcomes during a 90-day follow-up. Eur J Clin Invest 47:702–710. https://doi.org/10.1111/eci.12795
Daniels LB, Maisel AS (2007) Natriuretic peptides. J Am Coll Cardiol 50:2357–2368. https://doi.org/10.1016/j.jacc.2007.09.021
Saposnik G, Gladstone D, Raptis R et al (2013) Atrial fibrillation in ischemic stroke: predicting response to thrombolysis and clinical outcomes. Stroke 44:99–104. https://doi.org/10.1161/STROKEAHA.112.676551
Vaclavik D, Vilionskis A, Jatuzis D et al (2018) Clinical outcome of cardioembolic stroke treated by intravenous thrombolysis. Acta Neurol Scand 137:347–355. https://doi.org/10.1111/ane.12880
Zhang KJ, Jin H, Xu R et al (2021) N-terminal pro-brain natriuretic peptide is associated with hemorrhagic transformation and poor outcomes in patients with stroke treated with intravenous thrombolysis. Front Mol Neurosci 14:758915. https://doi.org/10.3389/fnmol.2021.758915
Hajdinjak E, Klemen P, Grmec S (2012) Prognostic value of a single prehospital measurement of N-terminal pro-brain natriuretic peptide and troponin T after acute ischaemic stroke. J Int Med Res 40:768–776. https://doi.org/10.1177/147323001204000243
Paciaroni M, Agnelli G, Corea F et al (2008) Early hemorrhagic transformation of brain infarction: rate, predictive factors, and influence on clinical outcome: results of a prospective multicenter study. Stroke 39:2249–2256. https://doi.org/10.1161/STROKEAHA.107.510321
Kalinin MN, Khasanova DR, Ibatullin MM (2017) The hemorrhagic transformation index score: a prediction tool in middle cerebral artery ischemic stroke. BMC Neurol 17:177. https://doi.org/10.1186/s12883-017-0958-3
Meyer M, Ronald J, Vernuccio F et al (2019) Reproducibility of CT radiomic features within the same patient: influence of radiation dose and CT reconstruction settings. Radiology 293(3):583–591. https://doi.org/10.1148/radiol.2019190928
The authors thank Enago (www.enago.cn/) for English language editing.
This research was funded by the Medical Research Program of the Chongqing National Health Commission and Chongqing Science and Technology Bureau, China (grant number 2021MSXM155), the project of Chongqing General Hospital (grant number Y2020MSXM07), and the Chongqing Postgraduate Scientific Research Innovation Project (grant number CYS22555).
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1. Table S1.
Models of CT Scanners and Scanning Parameters for Seven Institutions. Figure S1. Performance of different ICC thresholds in the internal validation.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ren, H., Song, H., Wang, J. et al. A clinical–radiomics model based on noncontrast computed tomography to predict hemorrhagic transformation after stroke by machine learning: a multicenter study. Insights Imaging 14, 52 (2023). https://doi.org/10.1186/s13244-023-01399-5
- Acute ischemic stroke
- Hemorrhagic transformation
- Noncontrast computed tomography
- Machine learning