Skip to main content
EJNMMI Research
Download PDF
  • Original research
  • Open access
  • Published:

18F-FDG PET/CT-based deep learning radiomics predicts 5-years disease-free survival after failure to achieve pathologic complete response to neoadjuvant chemotherapy in breast cancer

EJNMMI Research volume 13, Article number: 105 (2023) Cite this article

Abstract

Background

This study aimed to assess whether a combined model incorporating radiomic and depth features extracted from PET/CT can predict disease-free survival (DFS) in patients who failed to achieve pathologic complete response (pCR) after neoadjuvant chemotherapy.

Results

This study retrospectively included one hundred and five non-pCR patients. After a median follow-up of 71 months, 15 and 7 patients experienced recurrence and death, respectively. The primary tumor volume underwent feature extraction, yielding a total of 3644 radiomic features and 4096 depth features. The modeling procedure employed Cox regression for feature selection and utilized Cox proportional-hazards models to make predictions on DFS. Time-dependent receiver operating characteristic (ROC) curves and the area under the ROC curve (AUC) were utilized to evaluate and compare the predictive performance of different models. 2 clinical features (RCB, cT), 4 radiomic features, and 7 depth features were significant predictors of DFS and were included to develop models. The integrated model incorporating RCB, cT, and radiomic and depth features extracted from PET/CT images exhibited the highest accuracy for predicting 5-year DFS in the training (AUC 0.943) and the validation cohort (AUC 0.938).

Conclusion

The integrated model combining radiomic and depth features extracted from PET/CT images can accurately predict 5-year DFS in non-pCR patients. It can help identify patients with a high risk of recurrence and strengthen adjuvant therapy to improve survival.

Introduction

Breast cancer is the most commonly diagnosed cancer in women, posing a significant threat to their health and survival [1]. Locally advanced breast cancer is conventionally treated with neoadjuvant chemotherapy (NAC) [2]. Pathological complete response (pCR) after NAC is associated with improved disease-free survival (DFS) and overall survival (OS) outcomes [3,4,5,6,7]. For patients who do not achieve pCR, accurate prognostic assessment is crucial in determining appropriate treatment escalation or de-escalation, minimizing overtreatment for those with favorable prognosis and intensifying adjuvant therapy for those with an unfavorable prognosis to enhance survival. Known prognostic factors for breast cancer include age, axillary nodal status, tumor size, pathology, grade, and peritumoral lymphatic and vascular invasion [8]. Residual cancer burden (RCB) scores are commonly used as an independent predictor of survival. A higher RCB grade indicates a poorer prognosis [9]. The RCB scoring system focuses solely on the pathological factors related to tumors and lymph nodes after NAC. To enhance prognostic accuracy, the combination of multiple prognostic indicators has been advocated, as shown in recent studies [10].

The National Comprehensive Cancer Network (NCCN) Task Force recommends 18F-2-deoxy-2-fluoro-d-glucose (FDG) positron emission tomography/computed tomography (PET/CT) assessment for patients with locally advanced tumors that have higher risks of distant metastases due to nodal involvement [11]. PET/CT has distinct advantages over traditional imaging techniques because it provides information about the tumor’s metabolic and biological aspects characteristics and the patient's prognosis [12, 13]. Notably, PET texture analysis has been instrumental in providing critical prognostic information for solid tumors [14, 15].

Radiomics is a nascent area of research that transforms medical imaging features into quantifiable data used in decision support systems [16]. By improving knowledge of tumor behavior, radiomics holds promise to guide patient management at the bedside [17], thus bringing personalized medicine closer to reality [18]. Moreover, radiomics provides a comprehensive and non-invasive assessment of tumors, eliminating the need for invasive biopsies and reducing the potential for sampling errors [19]. Deep Learning (DL) is a method that directly extracts characteristics from images to produce faster and more precise results when compared to classical Machine Learning. DL models are capable of acquiring hierarchical characteristics from the image data through multiple layers, which operate in a depth-based manner for feature acquisition [20]. In recent research studies [21,22,23], DL has exhibited favorable performance concerning the detection and diagnosis of cancer. Nevertheless, the utilization of PET/CT radiomics and deep features for prognosis prediction in non-pCR breast cancer patients remains underexplored.

Hence, our study aimed to develop an integrated model, encompassing clinicopathologic factors, radiomic features, and depth information from baseline PET/CT scans. This combined model seeks to provide accurate long-term survival predictions for non-pCR patients, identifying high-risk populations and informing future treatment decisions.

Methods and materials

Patients

This retrospective study included 105 newly diagnosed stage II-III breast cancer patients who underwent PET/CT examination at Guangdong Provincial People's Hospital between January 2009 and December 2014. All patients received surgical treatment after completing NAC. The present study obtained approval from the Institutional Review Board of Guangdong Provincial People's Hospital. This study was performed following the Declaration of Helsinki's principles and requirements. As this was a retrospective study, formal consent was not obtained.

Eligible patients were female, aged 18 years and above, with histologically confirmed invasive breast cancer and clinically staged as T2-4N0-3M0 or T1cN1-3M0. Additionally, patients must have undergone PET/CT before receiving NAC and were confirmed as non-pCR after curative surgery following NAC completion. Patients who underwent direct surgical treatment, exhibited distant metastases, suffered from bilateral breast cancers, or had a previous history of breast cancer were excluded.

Tissue type, nuclear grading, hormone receptor expression, proliferative activity (Ki67), and human epidermal growth factor receptor 2 (HER2) status were recorded, and patients were classified based on St. Gallen molecular subtypes [24]. Immunohistochemical (IHC) markers for estrogen receptor (ER), progesterone receptor (PR), and HER2 were used to categorize patients into the following three molecular subtypes: luminal (ER-positive and/or PR-positive and HER2-negative), HER2-enriched (HER2-positive regardless of hormone receptor status) and triple-negative (ER-negative, PR-negative, and HER2-negative).

Breast cancer diagnosis and neoadjuvant chemotherapy regimen

The IHC results were judged using specific criteria. ER and PR positivity were defined as tumor cell nuclei with ≥ 1%, while those with < 1% were considered negative. HER2-positivity was defined as HER2 (+++), whereas HER2 (−) and HER2 (+) were considered HER2-negative. HER2 (++) required examination using fluorescence in situ hybridization (FISH) for HER2 gene expansion to enhance its detection. Gene amplification determined HER2-positive status, otherwise, it was considered negative. IHC results and non-pCR status were determined by our pathologists with 10 years of work experience. All NAC regimens were administered according to NCCN recommendation guidelines. Patients with HER2-positivity also received HER2-targeted therapy. Surgical excision was performed 2–3 weeks after completing NAC.

Follow-up evaluation

All patients were subject to postoperative follow-up starting from the day of their surgical intervention. During the five years following surgery, patients were examined every three to six months and had mammograms done once a year. Physical examinations and mammograms were conducted regularly on the patient for up to a decade following their surgical intervention. CT, PET/CT, or tissue biopsy was utilized to diagnose recurrence in cases where it was suspected. Recurrence was defined as any unambiguous evidence of the appearance of new cancer foci in a previously deemed disease-free patient. The duration of DFS was calculated by measuring the time from surgical intervention until the first evidence of cancer recurrence, death, or the latest clinical encounter confirming the absence of disease.

PET/CT imaging

To prepare for the scan, all patients were required to fast for a minimum of 6 h. Blood glucose levels must be below 10.0 mol/L before injection and the FDG dose is 7.4 MBq /kg. After intravenous injection, the patient rests in a dark room for 60 min before undergoing a 3D PET/CT measurement (Biograph16, 120 keV, 50 mAs). The CT scan was performed initially, covering the area from the proximal thighs to the head. PET data were then acquired over the same extent, after the CT scan, at a rate of 2–3 min per bed position. The process of analyzing PET and CT images that had been co-registered was executed utilizing a specialized workstation.

Image segmentation and preprocessing

The analysis and interpretation of the PET/CT images were performed by two experts in nuclear medicine. Using software (3D-Slicer), a large three-dimensional area of interest (3D-ROI) was plotted in each patient around the original breast lesion. The determination of ROI was done using a semi-automatic segmentation algorithm to ensure reproducibility and reliability. The open-source software 3DSlicer (https://www.slicer.org) is widely used for volume analysis of imaging data [25]. Then, the two expert doctors manually adjusted the ROI measurement to ensure measurement reliability. If there was a 5% difference between the two doctors, A senior nuclear medicine scientist would review and determine ROI. The details on image pre-processing are shown in the Additional file 1: S4.

Feature extraction

In this study, 3644 radiomic features and 4096 depth features were extracted from PET/CT images and ROI. We used PyRadiomics (https://github.com/ Radiomics/PyRadiomics) to obtain radiomic features that adhere to the Imaging Biomarker Standardization Initiative [26]. PyRadiomics provides advanced computational capabilities for image analysis, enabling the extraction of a multitude of features from images through sophisticated processing and filtering techniques. The ResNet 101 algorithm was used for depth feature extraction. A detailed description of deep neural network to extract depth features in the Additional file 1: S5. To address concerns regarding overfitting owing to the high dimensionality of available features, a random split in a 7:3 training and validation dataset ratio was performed. The training cohort in this study comprised 73 patients, whereas the validation cohort had 32 patients. Feature selection and model construction were performed according to the training cohort.

Feature selection and construction of five predictive models

To ensure feature stability within the ROI, we randomly selected 30 patients and conducted two separate ROI segmentation procedures performed by different radiologists. Then interclass correlation coefficient (ICC) of each feature was calculated. We employed the U test to select features exhibiting significant distinctions with prognosis to identify prognosis-correlated features. The Boruta method was used to calculate each feature’s Shapley value and the max shadow value. When a Shapley value was higher than the max shadow value, the corresponding feature was selected for further analysis. Finally, we used univariate analysis and the multivariate Cox analysis with multiple comparison correction to reduce the amounts of features. Then we used the final feature sets to construct models. After multivariate Cox analysis, 2 clinical, 4 radiomic, and 7 depth features were retained. Clinical features were retained to build two clinical models for predicting prognosis. Radiomic and deep prognosis models were built by using radiomic and depth features respectively. A combined model incorporating all available features was ultimately developed to predict prognosis. The procedure is summarized in Fig. 1.

Fig. 1
figure 1

Outline of the workflow from tumor segmentation, feature extraction, selection, and model construction, evaluation

Full size image

Statistical analysis

The Mann–Whitney U test was used to compare their inter-group difference. Univariate and multivariate analysis was conducted using the Cox proportional risk model to estimate the association between selected features and DFS. Hazard ratios (HR) and 95% confidence interval (CI) of each variable were obtained. A p < 0.05 was considered statistically significant. Detailed information is presented in Additional file 1: Table S1. We used time-dependent receiver operating characteristic (ROC) curves and the area under the ROC curve (AUC) to evaluate and compare the predictive performance of different models. Decision curve analysis (DCA) was employed to assess the strength and clinical relevance of the models.

Results

Patient and tumor characteristics

This retrospective study analyzed data from 105 female non-pCR breast cancer patients who underwent NAC, with 73 patients allocated to the training group and 32 patients assigned to the validation group. Patients were diagnosed at a mean age of 47 years and followed up for a median of 71 months. Among the patient population, 47 were diagnosed with clinical stage II disease, while 58 were diagnosed with clinical III stage disease. At the time of the last follow-up, 15 disease relapses and 7 deaths occurred, while 83 patients were alive without disease recurrence. Clinicopathologic features, including molecular subtypes, RCB score, menstrual status, and SUV, among other parameters, are presented in Table 1.

Table 1 Baseline characteristics of patients
Full size table

Feature extraction and selection for model construction

3644 radiomic features and 4096 depth features were extracted. To ensure the reproducibility of the features, a total of 1945 ineligible features with an ICC < 0.75 were excluded. The Mann–Whitney U test showed that 1536 features were significantly associated with prognosis. Then we performed independent Boruta feature selection. The Boruta method was used to select the important and robust features with higher Shapley values than the max shadow value by 1000 internals bootstrap. Finally, we used univariate analysis and the multivariate Cox analysis to reduce the amounts of features. We extracted and retained 4 radiomic features and 7 depth features. The results of univariate analysis and the multivariate Cox analysis with multiple comparison correction are presented Additional file 1: S3.

The radiomic features constitute a diverse set of feature groups, encompassing a range of methodologies including first-order statistical analysis and shape-based analysis. Detailed descriptions of these features can be obtained from Additional file 1: Table S2. Based on Cox analysis method, 4 radiomic features (Fig. 2D) and 7 depth features (Fig. 2E) associated with prognosis were ultimately selected for building the radiomics and DL models. Two clinical features (cT and RCB) were retained to construct clinical models. A combined model was also developed, utilizing clinical scores, radiomic scores, and depth scores to prognosticate non-PCR breast cancer patients after NAC. In Fig. 2A, the survival rates after 3 years and 5 years are shown. The name of the final retained radiomic features is presented in Additional file 1: S6.

Fig. 2
figure 2

Feature selection and a nomogram of prediction model. a Schematic diagram of prediction model. Each factor corresponded to one point, the scores of the four factors were summed to give a total score, and finally the corresponding 3-year, 5-year and 7-years survival rates were calculated. b Multivariate analysis showed different independent prognostic factors. c Schoenfeld residual test. The selected features in the radiomics model (d), DL model (e)

Full size image

Predictive performance of the five models

The combined model demonstrated the highest predictive ability for breast cancer prognosis in the training cohort, with an AUC value of 0.903 and 0.943 for 3-year and 5-year survival, respectively. AUC values of 0.835 and 0.884 were predicted by the DL model for 3-year and 5-year survival, while the radiomics model performed slightly lower, with AUC values of 0.766 and 0.849 for 3-year and 5-year survival, respectively. In contrast, the clinical models established using cT and RCB had poor predictive efficacy, with 5-year AUC values of 0.683 and 0.551, respectively. In the validation cohort, the combined model outperformed the other models demonstrating an AUC value of 0.889 and 0.938 for 3-year and 5-year survival, respectively. The deep learning and radiomics models showed AUC values of 0.875 and 0.806 for 5-year survival, respectively, while the clinical models had low predictive power with 5-year AUC values of 0.615 and 0.507 for cT and RCB, respectively. These outcomes indicate that the combined model is a more accurate predictor of DFS for non-pCR patients after NAC than other models. Figure 3 provides a comprehensive comparison of the five models, and ROC analysis and DCA curves confirmed the superiority of the combined model over other models in both the training and validation groups. Figure 4 shows predictive performance of the five models in training cohort and test cohort.

Fig. 3
figure 3

Training and testing cohort of ROC curve and DCA curve. The receiver operating characteristic (ROC) curves of the radiomics model, DL model, clinical models (T, RCB) and combined model in the training cohort (a, b) and validation cohort (c, d). The combined model demonstrated significantly higher AUCs in the training and validation cohorts than other models. Decision curve analysis (DCA) of the radiomics model, DL model and combined model in the training cohort (e, f) and validation cohort (g, h). The x-axis is the threshold probability, and the y-axis measures the net benefit. The combined model received a higher net benefit than the other two models across most ranges of reasonable threshold probabilities

Full size image
Fig. 4
figure 4

Predictive performance of the five models in training cohort (a) and test cohort (b). Training cohort (c) and validation cohort d calibration curve

Full size image

Stratification of disease-free survival by the five predictive models

All models were used to stratify the predicted survival of non-pCR patients after NAC. In the training cohort, DFS exhibited significant differences among breast cancer patients stratified by clinical, radiomic, DL, and combined models. The combined model demonstrated continued satisfactory stratification in the validation set, whereas the DL and radiomics models showed slightly poorer stratification. The integrated model had the best stratification ability among all models in identifying high-risk patients (Fig. 5).

Fig. 5
figure 5

Disease-free survival (DFS) curves of patients stratified by RCB model (a), clinical T model (b), radiomics model (c), DL model (d) and combined model (i) in the training cohort. The DFS curves of patients stratified by RCB model (e), clinical T model (f), radiomics model (g), DL model (h) and combined model j in the testing cohort. The DFS showed a significant difference between patients in combined model in training and testing cohort. Among all models, patients stratified by a combined model demonstrated the best capability in stratifying patients with high risk

Full size image

Discussion

Our study introduced and validated an integrated model that accurately stratifies non-pCR breast cancer patients based on clinicopathologic features, depth, and radiomic features extracted from PET/CT images obtained before NAC administration. The integrated model secured the highest AUC values among the independent validation cohort with a 3-year survival AUC value reaching 0.889 and a 5-year survival AUC value of 0.938, respectively.

We found that the model combining radiomic, depth features and clinicopathologic factors achieved better predictive performance than individual prognostic factors. Though some studies showed that patients with an increased RCB score have a high risk of a worse prognosis and shorter survival time [9, 27], and others have indicated that combining RCB and KI67 can provide better predictions than the RCB system [10, 28], highlighting the importance of including more comprehensive and meaningful information in prediction models. In both the training set and validation set, our combined model consistently outperforms the RCB model alone in accurately predicting the prognosis of breast cancer patients, with an AUC value of 0.943 and 0.938 for 5-year survival, respectively. This underscores the added value and potential synergistic effect of integrating radiomics with traditional clinical and pathological information for more accurate prognostic predictions in breast cancer patients.

Individual metabolic factors were not a reliable predictor of survival. PET/CT allows for the simultaneous assessment of metabolic and structural functions, with research primarily focusing on PET/CT metabolic parameters such as standard uptake value (SUV) and metabolic tumor volume (MTV) in predicting the prognosis of breast cancer patients [29,30,31,32,33]. Nonetheless, semi-quantitative parameters obtained from PET/CT images have certain limitations in their capacity to fully capture the heterogeneity of breast cancer. For instance, while SUVmax denotes solely the hottest pixel, MTV is reliant upon methods that are based on thresholds. Our study also included metabolic indicators such as SUVmax as relevant clinical factors for prognostic analysis, but individual metabolic factors alone did not improve predictive performance. This finding supports the controversy surrounding the inconsistency between 18F-FDG tumor uptake and prognosis prediction, which might be due to tumor heterogeneity and different research methods [34, 35].

We successfully developed an integrated model based on depth and radiomic features from PET images that accurately predicted long-term survival in non-pCR breast cancer patients. Radiomics and deep learning are efficient diagnostic tools with a variety of clinical applications [36, 37]. The extraction of numerous image features from the region of interest is achieved through the utilization of mathematical algorithms in these approaches [38], and non-invasive biomarkers derived from PET radiomics can be generated based on a range of pixel intensities, associated parameters, and positions of the images. [39]. Several studies were exploring the clinical and technical viability of PET radiomics for breast cancer diagnosis [40, 41], staging [42, 43], pathological characterization [44, 45], and prediction of response to NAC [46,47,48]. Clément Bouron [49] investigated to evaluate the prognostic value of baseline PET/CT metabolic parameters, volumetric parameters, and texture parameters for early TNBC breast cancer. The study revealed that imaging feature entropy demonstrated potential as a prognostic indicator. David [50] discovered that texture features exhibited a significant correlation with OS and DFS in patients with advanced breast cancer. However, few studies have investigated PET/CT radiomics and depth features for prognosis prediction in non-pCR breast cancer patients. In this study, our combined model incorporating tumor stage, RCB, radiomic, and depth features exhibited excellent performance, with a five-year survival AUC of 0.943 and 0.938 in the training and validation cohorts. The combined model also demonstrated robust clinical usefulness with greater benefits in both the training and validation cohorts in DCA curve analysis.

The limitations of the present study include a single-center design and retrospective methodology. To establish the validity and generalizability of our findings, additional research is warranted. While our deep learning model performed better than the radiomics model in the training set, further investigation is necessary to elucidate the interpretability of feature sources associated with this approach.

Conclusion

In conclusion, we formulated a comprehensive model that integrates radiomic and depth features obtained from PET/CT scans to forecast DFS in non-pCR patients. This amalgamated model serves as an efficient approach for projecting DFS in non-pCR patients diagnosed with breast cancer following NAC, potentially facilitating treatment refinement for individuals at high risk and thereby enhancing overall survival.

Availability of data and materials

The datasets used and analyzed during the current study are available from the corresponding authors on reasonable request.

Abbreviations

DFS:

Disease-free survival

pCR:

Pathological complete response

NAC:

Neoadjuvant chemotherapy

OS:

Overall survival

RCB:

Residual cancer burden

NCCN:

National Comprehensive Cancer Network

18F-FDG PET/CT:

18F-2-deoxy-2-fluoro-d-glucose (FDG) positron emission tomography/computed tomography

DL:

Deep learning

Ki67:

Proliferative activity

HER2:

Human epidermal growth factor receptor 2

IHC:

Immunohistochemical

FISH:

Fluorescence in situ hybridization

3D-ROI:

Three-dimensional area of interest

HR:

Hazard ratios

CI:

Confidence interval

ROC:

Receiver operating characteristic

DCA:

Decision curve analysis

SUV:

Standard uptake value

MTV:

Metabolic tumor volume

ER:

Estrogen receptor

PR:

Progesterone receptor

HR:

Hormone receptor

TNBC:

Triple-negative breast cancer

ICC:

Interclass correlation coefficient

References

  1. Siegel RL, Miller KD, Jemal A. Cancer statistics, 2016. CA Cancer J Clin. 2016;66:7–30. https://doi.org/10.3322/caac.21332.

    Article  PubMed  Google Scholar 

  2. Gradishar WJ, Anderson BO, Abraham J, Aft R, Agnese D, Allison KH, et al. Breast cancer, version 3.2020, NCCN clinical practice guidelines in oncology. J Natl Compr Canc Netw. 2020;18:452–78. https://doi.org/10.6004/jnccn.2020.0016.

    Article  CAS  PubMed  Google Scholar 

  3. Fisher B, Bryant J, Wolmark N, Mamounas E, Brown A, Fisher ER, et al. Effect of preoperative chemotherapy on the outcome of women with operable breast cancer. J Clin Oncol. 1998;16:2672–85. https://doi.org/10.1200/JCO.1998.16.8.2672.

    Article  CAS  PubMed  Google Scholar 

  4. Smith IC, Heys SD, Hutcheon AW, Miller ID, Payne S, Gilbert FJ, et al. Neoadjuvant chemotherapy in breast cancer: significantly enhanced response with docetaxel. J Clin Oncol. 2002;20:1456–66. https://doi.org/10.1200/JCO.2002.20.6.1456.

    Article  CAS  PubMed  Google Scholar 

  5. Pierga JY, Mouret E, Dieras V, Laurence V, Beuzeboc P, Dorval T, et al. Prognostic value of persistent node involvement after neoadjuvant chemotherapy in patients with operable breast cancer. Br J Cancer. 2000;83:1480–7. https://doi.org/10.1054/bjoc.2000.1461.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Liedtke C, Mazouni C, Hess KR, Andre F, Tordai A, Mejia JA, et al. Response to neoadjuvant therapy and long-term survival in patients with triple-negative breast cancer. J Clin Oncol. 2008;26:1275–81. https://doi.org/10.1200/JCO.2007.14.4147.

    Article  PubMed  Google Scholar 

  7. Kong X, Moran MS, Zhang N, Haffty B, Yang Q. Meta-analysis confirms achieving pathological complete response after neoadjuvant chemotherapy predicts favourable prognosis for breast cancer patients. Eur J Cancer. 2011;47:2084–90. https://doi.org/10.1016/j.ejca.2011.06.014.

    Article  PubMed  Google Scholar 

  8. Cianfrocca M, Goldstein LJ. Prognostic and predictive factors in early-stage breast cancer. Oncologist. 2004;9:606–16. https://doi.org/10.1634/theoncologist.9-6-606.

    Article  PubMed  Google Scholar 

  9. Symmans WF, Wei C, Gould R, Yu X, Zhang Y, Liu M, et al. Long-term prognostic risk after neoadjuvant chemotherapy associated with residual cancer burden and breast cancer subtype. J Clin Oncol. 2017;35:1049–60. https://doi.org/10.1200/JCO.2015.63.1010.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Pinard C, Debled M, Ben Rejeb H, Velasco V, Tunon de Lara C, Hoppe S, et al. Residual cancer burden index and tumor-infiltrating lymphocyte subtypes in triple-negative breast cancer after neoadjuvant chemotherapy. Breast Cancer Res Treat. 2020;179:11–23. https://doi.org/10.1007/s10549-019-05437-z.

    Article  CAS  PubMed  Google Scholar 

  11. Podoloff DA, Advani RH, Allred C, Benson AB 3rd, Brown E, Burstein HJ, et al. NCCN task force report: positron emission tomography (PET)/computed tomography (CT) scanning in cancer. J Natl Compr Canc Netw. 2007;5(1):S1-22 (quiz S3–2).

    Article  PubMed  Google Scholar 

  12. Hatt M, Visvikis D, Albarghach NM, Tixier F, Pradier O, Cheze-le RC. Prognostic value of 18F-FDG PET image-based parameters in oesophageal cancer and impact of tumour delineation methodology. Eur J Nucl Med Mol Imaging. 2011;38:1191–202. https://doi.org/10.1007/s00259-011-1755-7.

    Article  PubMed  Google Scholar 

  13. Wahl RL, Jacene H, Kasamon Y, Lodge MA. From RECIST to PERCIST: evolving considerations for PET response criteria in solid tumors. J Nucl Med. 2009;50(Suppl 1):122S-S150. https://doi.org/10.2967/jnumed.108.057307.

    Article  CAS  PubMed  Google Scholar 

  14. Cook GJ, Yip C, Siddique M, Goh V, Chicklore S, Roy A, et al. Are pretreatment 18F-FDG PET tumor textural features in non-small cell lung cancer associated with response and survival after chemoradiotherapy? J Nucl Med. 2013;54:19–26. https://doi.org/10.2967/jnumed.112.107375.

    Article  PubMed  Google Scholar 

  15. Chicklore S, Goh V, Siddique M, Roy A, Marsden PK, Cook GJ. Quantifying tumour heterogeneity in 18F-FDG PET/CT imaging by texture analysis. Eur J Nucl Med Mol Imaging. 2013;40:133–40. https://doi.org/10.1007/s00259-012-2247-0.

    Article  PubMed  Google Scholar 

  16. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, van Stiphout RG, Granton P, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. 2012;48:441–6. https://doi.org/10.1016/j.ejca.2011.11.036.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Limkin EJ, Sun R, Dercle L, Zacharaki EI, Robert C, Reuze S, et al. Promises and challenges for the implementation of computational medical imaging (radiomics) in oncology. Ann Oncol. 2017;28:1191–206. https://doi.org/10.1093/annonc/mdx034.

    Article  CAS  PubMed  Google Scholar 

  18. Collins FS, Varmus H. A new initiative on precision medicine. N Engl J Med. 2015;372:793–5. https://doi.org/10.1056/NEJMp1500523.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  19. Cook GJR, Siddique M, Taylor BP, Yip C, Chicklore S, Goh V. Radiomics in PET: principles and applications. Clin Transl Imaging. 2014;2:269–76. https://doi.org/10.1007/s40336-014-0064-0.

    Article  Google Scholar 

  20. LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521:436–44. https://doi.org/10.1038/nature14539.

    Article  CAS  PubMed  Google Scholar 

  21. Komura D, Ishikawa S. Machine learning approaches for pathologic diagnosis. Virchows Arch. 2019;475:131–8. https://doi.org/10.1007/s00428-019-02594-w.

    Article  CAS  PubMed  Google Scholar 

  22. Li C, Xue D, Hu Z, Chen H, Yao Y, Zhang Y, et al. A survey for breast histopathology image analysis using classical and deep neural networks. In: Pietka E, Badura P, Kawa J, Wieclawek W, editors., et al., Information technology in biomedicine. Cham: Springer International Publishing; 2019. p. 222–33.

    Chapter  Google Scholar 

  23. Wang D, Khosla A, Gargeya R, Irshad H, Beck AH. Deep learning for identifying metastatic breast cancer. 2016.

  24. Goldhirsch A, Winer EP, Coates AS, Gelber RD, Piccart-Gebhart M, Thurlimann B, et al. Personalizing the treatment of women with early breast cancer: highlights of the St Gallen International Expert Consensus on the Primary Therapy of Early Breast Cancer 2013. Ann Oncol. 2013;24:2206–23. https://doi.org/10.1093/annonc/mdt303.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Siavashpour Z, Aghamiri MR, Jaberi R, Dehghan-Manshadi HR, Sedaghat M, Kirisits C. Evaluating the utility of “3D Slicer” as a fast and independent tool to assess intrafractional organ dose variations in gynecological brachytherapy. Brachytherapy. 2016;15:514–23. https://doi.org/10.1016/j.brachy.2016.03.009.

    Article  PubMed  Google Scholar 

  26. Zwanenburg A, Leger S, Vallières M, Lck SJR, Oncology. Image biomarker standardisation initiative. 2016.

  27. Asano Y, Kashiwagi S, Goto W, Takada K, Takahashi K, Hatano T, et al. Prediction of survival after neoadjuvant chemotherapy for breast cancer by evaluation of tumor-infiltrating lymphocytes and residual cancer burden. BMC Cancer. 2017;17:888. https://doi.org/10.1186/s12885-017-3927-8.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  28. Hamy AS, Darrigues L, Laas E, De Croze D, Topciu L, Lam GT, et al. Prognostic value of the Residual Cancer Burden index according to breast cancer subtype: Validation on a cohort of BC patients treated by neoadjuvant chemotherapy. PLoS ONE. 2020;15: e0234191. https://doi.org/10.1371/journal.pone.0234191.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  29. Qu YH, Long N, Ran C, Sun J. The correlation of (18)F-FDG PET/CT metabolic parameters, clinicopathological factors, and prognosis in breast cancer. Clin Transl Oncol. 2021;23:620–7. https://doi.org/10.1007/s12094-020-02457-w.

    Article  CAS  PubMed  Google Scholar 

  30. Aogi K, Kadoya T, Sugawara Y, Kiyoto S, Shigematsu H, Masumoto N, et al. Utility of (18)F FDG-PET/CT for predicting prognosis of luminal-type breast cancer. Breast Cancer Res Treat. 2015;150:209–17. https://doi.org/10.1007/s10549-015-3303-9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Higuchi T, Nishimukai A, Ozawa H, Fujimoto Y, Yanai A, Miyagawa Y, et al. Prognostic significance of preoperative (18)F-FDG PET/CT for breast cancer subtypes. Breast. 2016;30:5–12. https://doi.org/10.1016/j.breast.2016.08.003.

    Article  PubMed  Google Scholar 

  32. Seban RD, Rouzier R, Latouche A, Deleval N, Guinebretiere JM, Buvat I, et al. Total metabolic tumor volume and spleen metabolism on baseline [18F]-FDG PET/CT as independent prognostic biomarkers of recurrence in resected breast cancer. Eur J Nucl Med Mol Imaging. 2021;48:3560–70. https://doi.org/10.1007/s00259-021-05322-2.

    Article  CAS  PubMed  Google Scholar 

  33. Groheux D, Sanna A, Majdoub M, de Cremoux P, Giacchetti S, Teixeira L, et al. Baseline tumor 18F-FDG uptake and modifications after 2 cycles of neoadjuvant chemotherapy are prognostic of outcome in ER+/HER2- breast cancer. J Nucl Med. 2015;56:824–31. https://doi.org/10.2967/jnumed.115.154138.

    Article  CAS  PubMed  Google Scholar 

  34. Garcia Vicente AM, Soriano Castrejon A, Lopez-Fidalgo JF, Amo-Salas M, Munoz Sanchez Mdel M, Alvarez Cabellos R, et al. Basal (1)(8)F-fluoro-2-deoxy-d-glucose positron emission tomography/computed tomography as a prognostic biomarker in patients with locally advanced breast cancer. Eur J Nucl Med Mol Imaging. 2015;42:1804–13. https://doi.org/10.1007/s00259-015-3102-x.

    Article  CAS  PubMed  Google Scholar 

  35. Choi WH, Han EJ, Choi EK, Chae BJ, Park YG, et al. The prognostic value of (18)F-FDG PET/CT for early recurrence in operable breast cancer: comparison with TNM stage. Nucl Med Mol Imaging. 2013;47:263–7. https://doi.org/10.1007/s13139-013-0232-6.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  36. Song D, Wang Y, Wang W, Wang Y, Cai J, Zhu K, et al. Using deep learning to predict microvascular invasion in hepatocellular carcinoma based on dynamic contrast-enhanced MRI combined with clinical parameters. J Cancer Res Clin Oncol. 2021;147:3757–67. https://doi.org/10.1007/s00432-021-03617-3.

    Article  CAS  PubMed  Google Scholar 

  37. Ning Z, Luo J, Li Y, Han S, Feng Q, Xu Y, et al. Pattern classification for gastrointestinal stromal tumors by integration of radiomics and deep convolutional features. IEEE J Biomed Health Inform. 2019;23:1181–91. https://doi.org/10.1109/JBHI.2018.2841992.

    Article  PubMed  Google Scholar 

  38. Paul R, Hawkins SH, Schabath MB, Gillies RJ, Hall LO, Goldgof DB. Predicting malignant nodules by fusing deep features with classical radiomics features. J Med Imaging (Bellingham). 2018;5: 011021. https://doi.org/10.1117/1.JMI.5.1.011021.

    Article  PubMed  Google Scholar 

  39. Sollini M, Cozzi L, Ninatti G, Antunovic L, Cavinato L, Chiti A, et al. PET/CT radiomics in breast cancer: mind the step. Methods. 2021;188:122–32. https://doi.org/10.1016/j.ymeth.2020.01.007.

    Article  CAS  PubMed  Google Scholar 

  40. Ou X, Wang J, Zhou R, Zhu S, Pang F, Zhou Y, et al. Ability of (18)F-FDG PET/CT radiomic features to distinguish breast carcinoma from breast lymphoma. Contrast Media Mol Imaging. 2019;2019:4507694. https://doi.org/10.1155/2019/4507694.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  41. Vogl WD, Pinker K, Helbich TH, Bickel H, Grabner G, Bogner W, et al. Automatic segmentation and classification of breast lesions through identification of informative multiparametric PET/MRI features. Eur Radiol Exp. 2019;3:18. https://doi.org/10.1186/s41747-019-0096-3.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Acar E, Turgut B, Yigit S, Kaya G. Comparison of the volumetric and radiomics findings of 18F-FDG PET/CT images with immunohistochemical prognostic factors in local/locally advanced breast cancer. Nucl Med Commun. 2019;40:764–72. https://doi.org/10.1097/MNM.0000000000001019.

    Article  CAS  PubMed  Google Scholar 

  43. Moscoso A, Ruibal A, Dominguez-Prado I, Fernandez-Ferreiro A, Herranz M, Albaina L, et al. Texture analysis of high-resolution dedicated breast (18) F-FDG PET images correlates with immunohistochemical factors and subtype of breast cancer. Eur J Nucl Med Mol Imaging. 2018;45:196–206. https://doi.org/10.1007/s00259-017-3830-1.

    Article  CAS  PubMed  Google Scholar 

  44. Lemarignier C, Martineau A, Teixeira L, Vercellino L, Espie M, Merlet P, et al. Correlation between tumour characteristics, SUV measurements, metabolic tumour volume, TLG and textural features assessed with (18)F-FDG PET in a large cohort of oestrogen receptor-positive breast cancer patients. Eur J Nucl Med Mol Imaging. 2017;44:1145–54. https://doi.org/10.1007/s00259-017-3641-4.

    Article  CAS  PubMed  Google Scholar 

  45. Ha S, Park S, Bang JI, Kim EK, Lee HY. Metabolic radiomics for pretreatment (18)F-FDG PET/CT to characterize locally advanced breast cancer: histopathologic characteristics, response to neoadjuvant chemotherapy, and prognosis. Sci Rep. 2017;7:1556. https://doi.org/10.1038/s41598-017-01524-7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  46. Antunovic L, De Sanctis R, Cozzi L, Kirienko M, Sagona A, Torrisi R, et al. PET/CT radiomics in breast cancer: promising tool for prediction of pathological response to neoadjuvant chemotherapy. Eur J Nucl Med Mol Imaging. 2019;46:1468–77. https://doi.org/10.1007/s00259-019-04313-8.

    Article  PubMed  Google Scholar 

  47. Lee H, Lee DE, Park S, Kim TS, Jung SY, Lee S, et al. Predicting response to neoadjuvant chemotherapy in patients with breast cancer: combined statistical modeling using clinicopathological factors and FDG PET/CT texture parameters. Clin Nucl Med. 2019;44:21–9. https://doi.org/10.1097/RLU.0000000000002348.

    Article  PubMed  Google Scholar 

  48. Huang Y, Zhu T, Zhang X, Li W, Zheng X, Cheng M, et al. Longitudinal MRI-based fusion novel model predicts pathological complete response in breast cancer treated with neoadjuvant chemotherapy: a multicenter, retrospective study. EClinicalMedicine. 2023;58: 101899. https://doi.org/10.1016/j.eclinm.2023.101899.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Bouron C, Mathie C, Seegers V, Morel O, Jezequel P, Lasla H, et al. Prognostic value of metabolic, volumetric and textural parameters of baseline [(18)F]FDG PET/CT in early triple-negative breast cancer. Cancers (Basel). 2022. https://doi.org/10.3390/cancers14030637.

    Article  PubMed  Google Scholar 

  50. Molina-Garcia D, Garcia-Vicente AM, Perez-Beteta J, Amo-Salas M, Martinez-Gonzalez A, Tello-Galan MJ, et al. Intratumoral heterogeneity in (18)F-FDG PET/CT by textural analysis in breast cancer as a predictive and prognostic subrogate. Ann Nucl Med. 2018;32:379–88. https://doi.org/10.1007/s12149-018-1253-0.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This study is supported by grants from National Natural Science Foundation of China (82171898), Deng Feng project of high-level hospital construction (DFJHBF202109), Guangdong Basic and Applied Basic Research Foundation (Grant Number 2022A1515012277, 2023A1515010222), Guangzhou Science and Technology Project (202002030236), Macao Science and Technology Development Fund (20210701181316106/AKP), Beijing Medical Award Foundation (YXJL-2020-0941-0758), and Beijing Science and Technology Innovation Medical Development Foundation (KC2022-ZZ-0091-5).  Funding sources were not involved in the study design, data collection, analysis and interpretation, writing of the report, or decision to submit the article for publication.

Author information

Authors and Affiliations

  1. Department of Breast Cancer, Cancer Center, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China

    Xingxing Zheng, Yuhong Huang, Teng Zhu, Jiachen Zou & Kun Wang

  2. Shantou University Medical College, Shantou, China

    Yingyi Lin

  3. Guangdong Medical University, Zhanjiang, China

    Jiachen Zou

  4. Department of Nuclear Medicine and PET Center, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China

    Shuxia Wang

Authors
  1. Xingxing Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuhong Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yingyi Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Teng Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jiachen Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Shuxia Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Kun Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the study conception and design. XZ and YH provided the overall design of the experiments and contributed equally to the study. Data collection were performed by YL, TZ and JZ. Data analysis and model building were performed by XZ and YH. XZ wrote the manuscript. YH and YL edited the manuscript. This study was supervised by KW and SW. All authors discussed and approved the final manuscript.

Corresponding authors

Correspondence to Shuxia Wang or Kun Wang.

Ethics declarations

Ethics approval and consent to participate

This retrospective study was approved by the Institutional Review Board of Guangdong Provincial People's Hospital. All procedures were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki declaration. As this was a retrospective study, formal consent was not obtained.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1

. Table S1. The results of cox analysis. Table S2. Summary of radiomics features. Table S3. Univariate and multivariate analyses with a Bonferroni calibration test. Table S4. Image pre-processing. Table S5. Basic principles of deep learning and neural networks. Table S6. The name of the final retained radiomic features.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zheng, X., Huang, Y., Lin, Y. et al. 18F-FDG PET/CT-based deep learning radiomics predicts 5-years disease-free survival after failure to achieve pathologic complete response to neoadjuvant chemotherapy in breast cancer. EJNMMI Res 13, 105 (2023). https://doi.org/10.1186/s13550-023-01053-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13550-023-01053-7

Keywords