- Original research
- Open Access
Automated Bone Scan Index as a quantitative imaging biomarker in metastatic castration-resistant prostate cancer patients being treated with enzalutamide
© Anand et al. 2016
Received: 11 December 2015
Accepted: 12 February 2016
Published: 9 March 2016
Having performed analytical validation studies, we are now assessing the clinical utility of the upgraded automated Bone Scan Index (BSI) in metastatic castration-resistant prostate cancer (mCRPC). In the present study, we retrospectively evaluated the discriminatory strength of the automated BSI in predicting overall survival (OS) in mCRPC patients being treated with enzalutamide.
Retrospectively, we included patients who received enzalutamide as a clinically approved therapy for mCRPC and had undergone bone scan prior to starting therapy. Automated BSI, prostate-specific antigen (PSA), hemoglobin (HgB), and alkaline phosphatase (ALP) were obtained at baseline. Change in automated BSI and PSA were obtained from patients who have had bone scan at week 12 of treatment follow-up. Automated BSI was obtained using the analytically validated EXINI BoneBSI version 2. Kendall’s tau (τ) was used to assess the correlation of BSI with other blood-based biomarkers. Concordance index (C-index) was used to evaluate the discriminating strength of automated BSI in predicting OS.
Eighty mCRPC patients with baseline bone scans were included in the study. There was a weak correlation of automated BSI with PSA (τ = 0.30), with HgB (τ = −0.17), and with ALP (τ = 0.56). At baseline, the automated BSI was observed to be predictive of OS (C-index 0.72, standard error (SE) 0.03). Adding automated BSI to the blood-based model significantly improved the C-index from 0.67 to 0.72, p = 0.017. Treatment follow-up bone scans were available from 62 patients. Both change in BSI and percent change in PSA were predictive of OS. However, the combined predictive model of percent PSA change and change in automated BSI (C-index 0.77) was significantly higher than that of percent PSA change alone (C-index 0.73), p = 0.041.
The upgraded and analytically validated automated BSI was found to be a strong predictor of OS in mCRPC patients. Additionally, the change in automated BSI demonstrated an additive clinical value to the change in PSA in mCRPC patients being treated with enzalutamide.
Bone metastasis is present in 90 % of patients with metastatic castration-resistant prostate cancer (mCRPC) . In such patients, the bone scan is the standard imaging modality to assess change in skeletal disease burden. However, the interpretation of the bone scan has significant limitations. The qualitative manual assessment of the bone scan is dependent on the skill and expertise of the local reader. Additionally, the criteria of counting new lesions to identify disease progression do not account for changes in disease distribution, increase in disease burden of existing lesions, or increase in confluent disease. Therefore, there is a need to qualify a fully quantitative assessment of disease burden in bone to detect post-treatment changes that are clinically relevant.
The manual Bone Scan Index (BSI), developed at the Memorial Sloan Kettering Cancer Center, is a fully quantitative assessment of bone scans that accounts for the metastatic lesions, as the percentage of total skeletal mass . The manual BSI and its changes at treatment follow-up have been shown to have a significant association with overall survival (OS) [3, 4]. Despite showing its clinical utility, the manual BSI has not been adopted in routine clinical practice due to the laborious process of manual calculations.
To overcome the limitations of manual assessment, the BSI methodology was automated using a computerized image analysis system that employed an artificial neural network . With the computer automation, the time of detecting metastatic lesion and calculating the BSI was reduced from an average 20 min (by an experienced reader) to 5 s per patient.
Recently, in a multi-institutional effort, we performed the analytical validation of an upgraded automated BSI platform in assessing change in bone scan of metastatic prostate cancer . The consistent linearity of the upgraded BSI platform overcame the limitation of its predecessor in underestimating the BSI values in patients with a higher (>5 BSI) tumor burden . Additionally, the upgraded automated BSI demonstrated that with minimal manual supervision, it can standardize the inter-operator variability in the assessment of change in bone scan. The result demonstrated the reliability of automated BSI in assessing change in bone scan and served as the foundation for future clinical studies.
Treatment with enzalutamide has shown to improve progression free survival and prolong OS in patients with mCRPC [8, 9]. In this hypothesis-generating retrospective study, we assessed the discriminatory strength of the upgraded automated BSI in predicting OS in mCRPC patients being treated with enzalutamide. As a part of the clinical qualification effort, the study here is aimed to provide justification for prospective validation of the upgraded and analytically validated automated BSI as a first quantitative imaging biomarker that can add clinical value to the treatment management of the mCRPC patients.
The retrospective study would aim to generate the hypothesis, for prospective validation, that as an imaging biomarker the automated BSI values provide distinct information and have an additive clinical value over the available blood-based markers. To evaluate the automated BSI as a marker with distinct information, the values of the BSI were associated with the values of the blood-based markers. To evaluate the additive clinical value of automated BSI, discriminatory strength of the blood-based biomarkers was assessed with and without the addition of automated BSI values in predicting OS of mCRPC patients being treated with enzalutamide.
All mCRPC patients who initiated treatment with Food and Drug Administration (FDA)-approved enzalutamide, from December 2012 to December 2014, at Skåne University Hospital in Malmö, Sweden, and at Copenhagen University Hospital (Rigshospitalet) in Copenhagen, Denmark, were considered for the study. CRPC was defined as the patients who had failed androgen deprivation therapy and had been clinically documented to have prostate-specific antigen (PSA) and/or radiological progression despite castrate level of testosterone (<20 ng/dL). Prior radiological scans were used to confirm the presence of metastasis. The mCRPC patients, who had undergone bone scan, as part of the clinical routine, before initiating enzalutamide treatment, were enrolled in the retrospective analysis. In these patients, we retrospectively collected the PSA, hemoglobin (HgB), and alkaline phosphatase (ALP) prior to initiating treatment with enzalutamide. Change in automated BSI and percent change in PSA were obtained from patients who had bone scan available at 12 week (±4 weeks) of treatment follow-up.
The retrospective study was performed in accordance with the Declaration of Helsinki. The ethical permission for the retrospective study and individual patient consent was obtained at the regional ethical review board at Lund University, Sweden, and at Rigshospitalet, Denmark.
The whole-body bone scan was obtained after 3 h of a single intravenous injection of 600 MBq Tc-99m methylene diphosphonate. Whole-body images with anterior and posterior views (scan speed 10 cm/min, 256 × 1024 matrix) were obtained using a gamma camera equipped with low-energy, high-resolution parallel hole collimators (Maxxus; General Electric, Milwaukee, WI, USA (Malmö); Precedence; Philips Healthcare, Eindhoven, The Netherlands (Copenhagen)). Energy discrimination was provided by a 15 % window centered on the 140 keV of Tc-99m.
Automated BSI analysis
The upgraded EXINI BoneBSI software (version 2), developed by EXINI Diagnostics AB (Lund, Sweden), was used to analyze the retrospectively collected bone scans and to generate automated BSI. The methodology of the automated platform has been described in detail in a previous study . In summary, the different anatomical regions of the skeleton are segmented followed by detection and classification of the abnormal hotspots as metastatic lesions. The weight fraction of the skeleton for each metastatic hotspot is calculated, and the BSI is calculated as the sum of all such fractions.
As a hypothesis generating retrospective study, no prior assumptions were made for the clinical utility of automated BSI to render power calculations. To evaluate the automated BSI as a distinct and independent variable, we used the Kendall’s tau (τ) and the Spearman’s rank correlation coefficient to determine the association between automated BSI and other blood-based biomarkers. Kendall’s tau and the Spearman’s rank correlation are the two available non-parametric rank correlations that measure the strength of association between two separate variables.
Kaplan Meier method was used to estimate the median OS of the baseline and of the treatment follow-up patient cohorts. Concordance index (C-index) and its standard error (SE) was used to evaluate the discriminatory strength of the automated BSI in predicting OS . To determine the additive strength of automated BSI as a biomarker, we compared the discrimination, C-index values , of the blood-based model to that of the blood-based model incorporating the automated BSI. C-index would allow the evaluation of the additive clinical value of automated BSI as a continuous covariate over the blood biomarkers, without stratifying the data with an arbitrary threshold. A strong concordance would indicate that the covariate is highly informative in predicting the relative risk of death between any two patients at a given time. Statistical significance for each statistical test was set at 0.05 (two-tailed). All statistical analyses were performed using R software version 3.1.2.
Demographic and clinical history of patients that qualified for the survival analysis
Patients evaluable at baseline
Patients evaluable at 12-week treatment follow-up
(N = 80)
(N = 62)
PSA at diagnosis
Prior systemic treatment
Non-parametric Kendall’s tau and Spearman correlation of automated BSI against blood-based biomarkers (N = 80)
Kendall’s tau (against BSI)
Spearman (against BSI)
A: C-index analysis of with and without the addition of BSI to blood based biomarkers at baseline. B: C-index analysis of change in BSI and PSA at treatment follow-up
A. Baseline analysisa (dead/total = 56/80)
PSA + ALP + HgB
PSA + ALP + HgB + BSI
B. Change (∆) at week 12 (dead/total = 40/62)
∆ PSA + ∆ BSI
Treatment follow-up analysis
Bone scan remains the standard imaging modality to assess radiographic progression-free survival in patients with mCRPC. As a primary endpoint, the progression-free survival has been accepted by FDA to show the treatment efficacy of novel therapy in patients with mCRPC . There is an unmet need for a quantitative and a reproducible assessment of bone scan that generate reliable data in multi-institutional registration trials. The study presented here is an incremental progress of the automated BSI towards its qualification as an imaging biomarker with clinical relevance in mCRPC patients. Compared to its predecessor, which underestimated the BSI values in patients with a high tumor burden (>5 BSI), the upgraded EXINI BoneBSI (version 2) platform generates a consistent BSI assessment for patient with low and high tumor burdens. The performance of the commercially available platform was recently evaluated in a multi-institutional analytical validation study . In this hypothesis-generating study, we have demonstrated that the upgraded automated BSI is a strong predictor of OS with an additive clinical value to the existing blood-based biomarkers.
In baseline survival analysis, our study demonstrated that the automated BSI was predictive of OS (C-index 0.72). The independent and additive clinical value of automated BSI was demonstrated in the significant improvement of the blood-based model’s discrimination in predicting OS (C-index from 0.67 to 0.72). Additionally, the weak correlation between the automated BSI and the blood-based biomarkers implied that the automated BSI is an independent marker with distinct quantitative information that can add to the clinical evaluation of patients with skeletal metastasis. Our data supports the initial findings of the original manual BSI studies that have demonstrated significant and strong association with OS in patients with mCRPC . The data is also in agreement with the previous version of a computer-automated BSI platform that demonstrated the prognostic value of the automated BSI in newly diagnosed and in mCRPC patients [7, 13]. The result should encourage investigators to evaluate the role of automated BSI in existing prognostic models for metastatic prostate cancer, which noticeably lacked a quantitative imaging parameter indicative of skeletal disease burden [1, 14]. The baseline analysis in our study was limited by the unavailability of lactate dehydrogenase and albumin, both of which have demonstrated an association with OS and are part of the baseline prognostic model in mCRPC patients.
Enzalutamide prevents the translocation of the androgen receptor to nucleus that prevents the activation of some proliferative genes, which includes PSA. In its registration studies, enzalutamide has shown improvement in OS with early measure of response shown by percent PSA decline at week 12 [8, 15]. In agreement to these studies, we observed a marked decrease in percent PSA change at week 12 of treatment with enzalutamide (median = [−] 0.60, IQR = [−] 0.12–[−] 0.86). The study also demonstrated that the combined model, including the change in automated BSI and the percent change in PSA, was significantly stronger in discriminating for OS than the percent change in PSA alone. The data is unique in its attempt to establish that with consistent linearity, the change in automated BSI of the upgraded platform is not only reproducible but is also clinically relevant. In Japan, Mitsui et al. has similarly demonstrated improvement in C-index with addition of automated BSI to PSA (from 0.62 to 0.66) . However, it should be noted that the platform used in the Mitsui et al. work, BONENAVI®, has been uniquely trained on a data set consisting exclusively of Japanese patients and therefore caters to a distinct population base .
As an indirect measurement of disease burden, PSA and bone scan lesions are known to increase temporarily within few weeks of response to an effective therapy. This increase, specifically observed in bone scan, is commonly referred to as flare phenomenon. Comprehensive investigations in patients with metastatic prostate cancer have shown the flare to peak at weeks 6–8 of treatment follow-up [18, 19]. Therefore, Prostate Cancer Working Group 2 (PCWG2) criteria recommend that early changes (before 12 weeks) in PSA and radionuclide bone scan should be ignored . Although the evidence of the flare phenomenon in mCRPC patients being treated with enzalutamide is quite limited, if not non-existent, the current study evaluated the change in automated BSI and in PSA at week 12 of treatment follow-up. Following the PCWG2 recommendation, the analysis at week 12 of treatment follow-up minimizes but does not overcome the risk of flare and its limitation on the clinical evaluation of automated BSI.
The current study was limited in its scope as a retrospective analysis. However, with its enrollment criteria, the study was controlled for the standardized time point analysis at pre-treatment and at 12-week treatment follow-up for each of the respective covariates. A reasonable large number of patients were included from the two separate hospitals to avoid site selection biases. The data presented here, using an upgraded and analytically validated platform, confirms the original clinical findings of the manual BSI studies. More importantly, the study is part of the continual effort to clinically validate automated BSI as an imaging biomarker to quantify the change in total skeletal tumor burden that is clinically relevant. The computer-automated BSI represents an opportunity to realize the clinical potential of a standard imaging modality, bone scan, which has been limited by the variability of visual assessment.
In the present study, our data has demonstrated that the analytically validated automated BSI is an independent and a strong predictor of OS in mCRPC patients. The study also found that the change in automated BSI has an additive clinical value to the change in PSA in mCRPC patients being treated with enzalutamide. The data presented here confirms the initial findings of the original manual BSI studies and serve as the foundation for future prospective studies aimed to clinically validate automated BSI as an imaging biomarker in mCRPC patients.
This study was funded by grants from the Swedish Cancer Foundation (grant number 140274), the Swedish Medical Research Council (grant number D0484201), and governmental funding of the clinical research within the National Health Services in Sweden through Lund University (grant number ALFSKANE 440281).
We thank Professor Mattias Ohlsson, PhD, at the Department of Astronomy and Theoretical Physics, Lund University, Lund, Sweden, for his guidance in the statistical analysis of the study.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
- Halabi S, Lin CY, Kelly WK, Fizazi KS, Moul JW, Kaplan EB, et al. Updated prognostic model for predicting overall survival in first-line chemotherapy for patients with metastatic castration-resistant prostate cancer. J Clin Oncol. 2014;32(7):671–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Imbriaco M, Larson SM, Yeung HW, Mawlawi OR, Erdi Y, Venkatraman ES, et al. A new parameter for measuring metastatic bone involvement by prostate cancer: the Bone Scan Index. Clin Cancer Res. 1998;4(7):1765–72.PubMedGoogle Scholar
- Sabbatini P, Larson SM, Kremer A, Zhang ZF, Sun M, Yeung H, et al. Prognostic significance of extent of disease in bone in patients with androgen-independent prostate cancer. J Clin Oncol. 1999;17(3):948–57.PubMedGoogle Scholar
- Dennis ER, Jia X, Mezheritskiy IS, Stephenson RD, Schoder H, Fox JJ, et al. Bone scan index: a quantitative treatment response biomarker for castrationresistant metastatic prostate cancer. J Clin Oncol. 2012;30(5):519–24.View ArticlePubMedPubMed CentralGoogle Scholar
- Sadik M, Suurkula M, Hoglund P, Jarund A, Edenbrandt L. Improved classifications of planar whole-body bone scans using a computer-assisted diagnosis system: a multicenter, multiple-reader, multiple-case study. J Nucl Med. 2009;50(3):368–75.View ArticlePubMedGoogle Scholar
- Anand A, Morris MJ, Kaboteh R, Bath L, Sadik M, Gjertsson P, et al. Analytic Validation of the Automated Bone Scan Index as an Imaging Biomarker to Standardize Quantitative Changes in Bone Scans of Patients with Metastatic Prostate Cancer. J Nucl Med. 2016;57(1):41–5.View ArticlePubMedGoogle Scholar
- Ulmert D, Kaboteh R, Fox JJ, Savage C, Evans MJ, Lilja H, et al. A novel automated platform for quantifying the extent of skeletal tumour involvement in prostate cancer patients using the Bone Scan Index. Eur Urol. 2012;62(1):78–84.View ArticlePubMedPubMed CentralGoogle Scholar
- Scher HI, Fizazi K, Saad F, Taplin ME, Sternberg CN, Miller K, et al. Increased survival with enzalutamide in prostate cancer after chemotherapy. N Engl J Med. 2012;367(13):1187–97.View ArticlePubMedGoogle Scholar
- Beer TM, Tombal B. Enzalutamide in metastatic prostate cancer before chemotherapy. N Engl J Med. 2014;371(18):1755–6.View ArticlePubMedGoogle Scholar
- Pencina MJ, D'Agostino RB. Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation. Stat Med. 2004;23(13):2109–23.View ArticlePubMedGoogle Scholar
- Haibe-Kains B, Desmedt C, Sotiriou C, Bontempi G. A comparative study of survival models for breast cancer prognostication based on microarray data: does a single gene beat them all? Bioinformatics. 2008;24(19):2200–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Kluetz PG, Ning YM, Maher VE, Zhang L, Tang S, Ghosh D, et al. Abiraterone acetate in combination with prednisone for the treatment of patients with metastatic castration-resistant prostate cancer: U.S. Food and Drug Administration drug approval summary. Clin Cancer Res. 2013;19(24):6650–6.View ArticlePubMedGoogle Scholar
- Armstrong AJ, Kaboteh R, Carducci MA, Damber JE, Stadler WM, Hansen M, et al. Assessment of the bone scan index in a randomized placebo-controlled trial of tasquinimod in men with metastatic castration-resistant prostate cancer (mCRPC). Urol Oncol. 2014;32(8):1308–16.View ArticlePubMedGoogle Scholar
- Armstrong AJ, Garrett-Mayer E, de Wit R, Tannock I, Eisenberger M. Prediction of survival following first-line chemotherapy in men with castration-resistant metastatic prostate cancer. Clin Cancer Res. 2010;16(1):203–11.View ArticlePubMedGoogle Scholar
- Beer TM, Armstrong AJ, Rathkopf DE, Loriot Y, Sternberg CN, Higano CS, et al. Enzalutamide in metastatic prostate cancer before chemotherapy. N Engl J Med. 2014;371(5):424–33.View ArticlePubMedPubMed CentralGoogle Scholar
- Mitsui Y, Shiina H, Yamamoto Y, Haramoto M, Arichi N, Yasumoto H, et al. Prediction of survival benefit using an automated bone scan index in patients with castration-resistant prostate cancer. BJU Int. 2012;110(11 Pt B):E628–34.View ArticlePubMedGoogle Scholar
- Takahashi Y, Yoshimura M, Suzuki K, Hashimoto T, Hirose H, Uchida K, et al. Assessment of bone scans in advanced prostate carcinoma using fully automated and semi-automated bone scan index methods. Ann Nucl Med. 2012;26(7):586–93.View ArticlePubMedGoogle Scholar
- Cook GJ, Venkitaraman R, Sohaib AS, Lewington VJ, Chua SC, Huddart RA, et al. The diagnostic utility of the flare phenomenon on bone scintigraphy in staging prostate cancer. Eur J Nucl Med Mol Imaging. 2011;38(1):7–13.View ArticlePubMedGoogle Scholar
- Morris MJ, Molina A, Small EJ, de Bono JS, Logothetis CJ, Fizazi K, et al. Radiographic progression-free survival as a response biomarker in metastatic castration-resistant prostate cancer: COU-AA-302 results. J Clin Oncol. 2015;33(12):1356–63.View ArticlePubMedGoogle Scholar
- Scher HI, Halabi S, Tannock I, Morris M, Sternberg CN, Carducci MA, et al. Design and end points of clinical trials for patients with progressive prostate cancer and castrate levels of testosterone: recommendations of the Prostate Cancer Clinical Trials Working Group. J Clin Oncol. 2008;26(7):1148–59.View ArticlePubMedPubMed CentralGoogle Scholar