SUVref: reducing reconstruction-dependent variation in PET SUV
© Kelly and Declerck; licensee Springer. 2011
Received: 5 May 2011
Accepted: 18 August 2011
Published: 18 August 2011
We propose a new methodology, reference Standardised Uptake Value (SUVref), for reducing the quantitative variation resulting from differences in reconstruction protocol. Such variation that is not directly addressed by the use of SUV or the recently proposed PERCIST can impede comparability between positron emission tomography (PET)/CT scans.
SUVref applies a reconstruction-protocol-specific phantom-optimised filter to clinical PET scans for the purpose of improving comparability of quantification. The ability of this filter to reduce variability due to differences in reconstruction protocol was assessed using both phantom and clinical data.
SUVref reduced the variability between recovery coefficients measured with the NEMA image quality phantom across a range of reconstruction protocols to below that measured for a single reconstruction protocol. In addition, it enabled quantitative conformance to the recently proposed EANM guidelines. For the clinical data, a significant reduction in bias and variance in the distribution of differences in SUV, resulting from differences in reconstruction protocol, greatly reduced the number of hot spots that would be misclassified as undergoing a clinically significant change in SUV.
SUVref significantly reduces reconstruction-dependent variation in SUV measurements, enabling increased confidence in quantitative comparison of clinical images for monitoring treatment response or disease progression. This new methodology could be similarly applied to reduce variability from scanner hardware.
The Standardised Uptake Value (SUV) is a widely used metric for quantifying radiotracer (particularly 18 F-2-fluoro-2-deoxy-D-glucose) uptake in clinical positron emission tomography (PET) scans. Its use is intended to provide normalisation for differences in patient size and body composition along with the dose of radiotracer injected, thereby enabling inter-study comparison between and within individual patients [1, 2].
While variations in body composition and injected dose represent one significant source of variation, differences in scanner hardware and reconstruction represent another; however, these differences are not addressed by the use of SUV. These unaddressed sources of variation impede wider acceptance of PET as a quantitative imaging tool for lesion characterization, prognostic stratification and treatment monitoring, since differences in scanner hardware and reconstruction can significantly impact generated SUV .
A variety of proposals have been suggested to address the issue of scanner hardware/reconstruction-dependent variation in SUV. For example, the European Association of Nuclear Medicine (EANM) procedure guidelines , following on from the Netherlands protocol , provide specifications for activity concentration recovery coefficients (RC), as measured with the National Electrical Manufacturers Association (NEMA) Image Quality phantom . RCs measure the ability of an imaging system to recover the true activity concentration ratio between regions filled with different activity concentrations. They are a useful indicator of clinical scanner performance, incorporating the effects of scanner resolution, sensitivity, accuracy of the various corrections performed along with the reconstruction parameters used (e.g. number of iterations and subsets, post-filter smoothing). Given these specifications, reconstruction settings should be determined for each scanner so as to generate RCs within the specified bounds. A similar approach has also been proposed by Weber and colleagues . While following such an approach will reduce the variation in SUV due to differences in scanner performances and reconstruction protocol, it can negate the benefits of advances in technology which improves image quality if reconstructions are constrained to produce RCs in line with those achievable using older models of scanner. Typically, the most sensitive and advanced scanners and reconstruction techniques produce RCs which exceed the upper bounds of the protocol. Conversely, RCs that fall below the lower bounds may be improved through modification of the reconstruction parameters; however, achieving this typically requires additional iterations or reduced post-filtering, both of which increase image noise.
A different approach is used by Joshi and colleagues  as part of the Alzheimer's Disease Neuroimaging Initiative project. The authors apply an additional scanner-specific smoothing kernel to data from each scanner in a multi-centre trial in order to smooth all images to a common resolution. While this method succeeds in reducing the variability between datasets by 15% to 20%, it again produces images smoothed to that of the lowest resolution scanner. Furthermore, the requirement to register the clinical dataset to smoothed versions of the digital Hoffman brain phantom to determine the appropriate smoothing kernel using a voxel-wise comparison, makes the method difficult to extend to whole body data.
We propose another approach that combines reducing the variation in SUV due to differences in scanner performances and reconstruction protocol while avoiding the need to constrain reconstructions to produce RCs in line with those achievable using older models of scanner, which may negatively affect lesion detectability. The reference SUV (SUVref) methodology allows users to continue to take advantage of improvements in image quality, from developments in scanner hardware and reconstruction technologies, when reviewing the clinical images. This method is not meant to address other sources of inter-scan variation in SUV, which are of biological nature. These can only be minimised by careful preparation of the patient for each scan. The aim of the SUVref methodology is to reduce to a minimum the non-biological effects which may affect the calculation of SUV. The methodology can be applied to the comparison of two acquisition/reconstruction protocols as well as for multi-acquisition/reconstruction protocol comparisons. This has relevance for clinical scenarios in which an absolute SUV threshold is used to indicate malignancy, estimate prognosis or predict response to therapy. It is also applicable for centres in which a patient receives follow-up scans on a different scanner or using a different reconstruction, for example, following a scanner upgrade or in sites with multiple scanners.
Similar to the method described by Joshi and colleagues , a scanner- and reconstruction-specific smoothing filter is applied to clinical data; however, this filtered image is used only for quantification with the originally reconstructed image used for visualisation. As such, the reading physician can take advantage of the improvements in image quality and lesion detectability associated with advances in scanner hardware and reconstruction .
Since the filtered image is used only for quantification, filter selection is performed so as to minimise the variation in activity concentration RCs between images. For each reconstruction protocol, RCs are measured using the NEMA Image Quality (IQ) phantom, prepared and imaged as per the NEMA Standards Publication NU 2-2007 . In contrast to the Standard however, the RC for each hot sphere (i.e. those with diameters 10, 13, 17 and 22 mm) is measured using the voxel with the maximum activity from a 3D volume of interest corresponding to the dimensions of the sphere. The value of the maximum voxel rather than the mean within the sphere dimensions is used to reflect the typical clinical practice for evaluation of lesions. Background activity is measured as per the NEMA Standard.
These RCs are then compared to a set of reference RCs and the root mean squared error (RMSE) calculated. This comparison is repeated following convolution of the original image with a Gaussian kernel of increasing full width half max (FWHM). The kernel size that minimises the RMSE when compared to the reference RCs is selected as the SUVref filter for that scanner/reconstruction protocol combination.
The reference RCs could be determined from a specific set of scanner/reconstruction combinations used as part of a clinical trial (i.e. by taking the lowest set of RCs from the scanner/reconstruction combination with the lowest resolution). Alternatively, they could be taken from a published standard such as that defined by Boellaard et al. . For this study, we have used the reference RCs published by Boellaard et al. ; although as the phantom was filled according to the NEMA Standards Publication NU 2-2007 , we have only used the RCs from the four smallest spheres. This does not affect the generality of the approach, and the method and results obtained for four spheres could be easily extended to six sphere phantoms. In addition, the reference RCs published by Boellaard et al.  were generated using a phantom prepared with a sphere-to-background ratio of 8:1 in contrast to the 4:1 phantom used in this study. However, this difference does not preclude the use of these published RCs as an example reference set.
Phantom data study
The impact of SUVref on variation in quantification due to differences in reconstruction was investigated using both phantom and clinical data. For the phantom studies, a 68Ge-filled NEMA IQ phantom, with a total activity of 116.37 MBq and a hot sphere-to-background ratio of 4:1, was acquired 15 times with a frame duration of 9 min each on a 3-ring Biograph mCT with 64-slice computed tomography (CT) and 4 × 4 mm lutetium oxyorthosilicate crystals (Siemens Healthcare, Molecular Imaging). Each of the 15 acquisitions was reconstructed with four different reconstruction protocols: OSEM 3D with 2 iterations, 24 subsets and a 5-mm FWHM Gaussian post-filter (OSEM); a point spread function reconstruction  with 3 iterations, 24 subsets and a 4-mm FWHM Gaussian post-filter (PSF); PSF with time of flight (TOF) with 2 iterations, 21 subsets and a 2-mm FWHM Gaussian post-filter (TOF1); and PSF-TOF with 3 iterations, 21 subsets and an all-pass filter (TOF2). All reconstructions were performed on a 200 × 200 matrix. The first three protocols are as recommended by Siemens Healthcare for whole body PET/CT scan oncological reading. The additional PSF-TOF protocol with an extra iteration was selected to provide higher RCs.
For each reconstructed dataset, the RCs were calculated, based on the maximum voxel intensity in each hot sphere. The variation in these RCs across the 15 repeats for each reconstruction protocol was measured, along with the variation between the different reconstruction protocols, using the relative standard deviation (RSD). These measurements were repeated following application of the appropriate SUVref filter to each of the datasets prior to measurement of the maximum voxel intensity in each hot sphere. An SUVref filter was computed for each individual dataset, and the mean filter size across all repeats for a given reconstruction protocol applied to those datasets for the analysis.
The same analysis was performed using the SUVpeak measure as described by Wahl and colleagues  in the PET Response Criteria in Solid Tumors (PERCIST). PERCIST provides a structured framework for quantitative clinical reporting, with precise recommendations for how uptake in a lesion should be quantified (i.e. lean body mass corrected SUVpeak). This builds on more general guidelines such as those published by the European Organisation for Research and Treatment of Cancer (EORTC) . SUVpeak is the mean value within a 1 cm3 spherical region positioned within a lesion so as to maximise this value. The motivation behind SUVpeak was to provide a value less sensitive to noise than the SUVmax and less dependent on lesion delineation than SUVmean. Although not intended to address reconstruction and scanner-dependent variation, it also involves the application of a smoothing filter (although non-Gaussian) to an image for the purpose of quantification, which combined with its potential acceptance by the PET community makes it an interesting measure for comparison with the SUVref methodology.
Finally, a combination of SUVref and SUVpeak was evaluated, SUVref,peak in which the peak value is computed from the SUVref filtered image.
Clinical data study
where SUV a is the SUVmax measured for a given hotspot on the image reconstructed with protocol a, and SUV b is the SUVmax measured for the corresponding hotspot on the image reconstructed with protocol b. Reconstruction protocols a and b represent one of the six possible pairings of the four reconstruction protocols used. For each pairing, the reconstruction with the largest SUVref filter computed in the phantom study was selected as protocol a.
This analysis was repeated using the same set of 500 hotspots, following application of the appropriate SUVref filter to each reconstruction prior to measurement of the maximum voxel intensity, to compute percentage change in SUVref (Δ SUVref). The SUVref filters used were those derived from the 68Ge phantom study described above. The same analysis was also repeated using the SUVpeak measure to compute Δ SUVpeak.
The sensitivity of the SUVref methodology to filter size was assessed by applying non-optimal SUVref filters and measuring the effect on Δ SUVref. This assessment was performed for the comparison of PSF with OSEM and for TOF1 with OSEM. The non-optimal filters for each pairwise comparison were selected by increasing the FWHM of the mean SUVref filter for the reconstruction with the lowest RCs (i.e. OSEM) by twice the standard deviation (SD) of the mean filter FWHM for that reconstruction from the phantom study, and decreasing the FWHM of the optimal filter for the reconstruction with the highest RCs (i.e. PSF or TOF1) by the corresponding amount.
The effect of hotspot location on the performance of SUVref was assessed by separating the set of 500 clinical hotspots into two groups, lateral and medial. The threshold for this separation was arbitrarily selected as 75 mm from the centre of the transaxial field of view since this resulted in equal size groups. The motivation for this comparison was to evaluate any effect on SUVref performance of comparing PSF-based reconstructions with an improved resolution uniformity throughout the transaxial FOV, compared with a traditional OSEM reconstruction .
Finally, to investigate the impact of SUVref on measuring response, a subset of 25 lung hotspots were extracted from the original 500 clinical hotspots. All 300 possible pairwise combinations of these hotspots were then used to simulate response studies, with one of each pair providing the baseline measurement and the other the follow-up measurement. For each simulated response study, the percentage change was calculated using both SUVmax and SUVref, as described above, for each of the four reconstruction protocols, with the same reconstruction protocol used per simulated measurement of response. The mean absolute difference in calculated percentage change for each pair of hotspots across the four reconstruction protocols was then compared for SUVmax and SUVref.
Phantom data study
Mean SUVref filters computed for the four reconstruction protocols
Reconstruction protocol a
SUVref filter FWHM (mm)
OSEM 2i24s5 mm (OSEM)
PSF 3i24s4 mm (PSF)
PSF-TOF 2i21s2 mm (TOF1)
PSF-TOF 3i21s0 mm (TOF2)
Mean RSD of the RCs for each reconstruction protocol and across all protocols
Mean RSD with SUV max (%)
Mean RSD with SUV peak (%)
Mean RSD with SUV ref (%)
Mean RSD with SUV ref,peak (%)
Clinical data study
Percentage of hotspots with a Δ SUVmax , Δ SUVpeak , Δ SUVref or Δ SUVref,peak greater than specified difference threshold
Percentage with SUV max (%)
Percentage with SUV peak (%)
Percentage with SUV ref (%)
Percentage with SUV ref,peak (%)
Effect of non-optimal filters on Δ SUVmax and Δ SUVref , for PSF and OSEM reconstruction protocols
Percentage with SUV max (%)
Percentage with SUV ref (%)
Percentage with non-optimal SUV ref (%)
Effect of non-optimal filters on Δ SUVmax and Δ SUVref , for TOF1 and OSEM reconstruction protocols
Percentage with SUVmax (%)
Percentage with SUVref (%)
Percentage with non-optimal SUVref (%)
Effect of hotspot location on Δ SUVmax and Δ SUVref
Percentage with SUV max (%)
Percentage with SUV ref (%)
Finally, the assessment of the impact of SUVref on response assessment, when the same reconstruction protocol is used for both the baseline and follow-up study, showed a significant reduction in the mean absolute difference in percentage change, as measured across the four different reconstruction protocols, from 11.8% (8.7% SD) with SUVmax to 6.8% (6.2% SD) with SUVref (P < 0.01 with the Wilcoxon Matched-Pairs Signed-Ranks Test).
Variations in reconstruction protocol can have a major effect on quantifiable parameters such as contrast recovery. For example, in the phantom experiments described above, the RC for the 10-mm hot sphere varies from 0.42 to 0.78 and from 1.01 to 1.33 for the 22-mm hot sphere. Following application of the appropriate SUVref filters, this variation reduces to 0.38 to 0.43 for the 10-mm hot sphere and 0.93 to 1.04 for the 22-mm hot sphere. In fact, with SUVref the mean variation in RC across all reconstruction protocols studied is smaller than the mean variation in RC within a single reconstruction protocol. A reduction in RC variation was also observed with the PERCIST measure SUVpeak; however, the variation across all reconstruction protocols was significantly larger than for SUVref. The combination of SUVref and SUVpeak in SUVref,peak reduces the variation across reconstruction protocols further still.
In addition to reducing the variation resulting from differences in reconstruction protocol, SUVref can be defined to produce RCs within the bounds specified by the recently published EANM specification . Given all reconstructions evaluated with SUVmax produced RCs that were above the EANM-specified bounds, application of the SUVref filter would ensure clinical sites using these reconstruction protocols produced quantifiably conforming values whilst allowing them to take advantage of improvements in image quality associated with advanced reconstruction protocols. With SUVpeak, more than 90% of reconstructions evaluated produced RCs outside EANM-specified bounds. Given the distribution of these outliers both above and below the specified bounds, significant widening of the bounds would be required to accommodate SUVpeak, and therefore reduce the benefit of the specification.
The potential clinical impact of the reductions in RC variability with SUVref was presented in Table 3. For example, if a percentage change in SUVmax of greater than 30% is selected as signifying a clinically relevant change in the status of a lesion, either disease progression or treatment response, then for the combination of reconstruction protocols evaluated, a clinically relevant change would be incorrectly observed nearly 20% of the time, compared to just 1% with SUVref, when in fact there is no change in the underlying data. This reduction results from the reduction in bias and variation shown in Figure 2. In PERCIST, a threshold of 30% is used with SUVpeak to signify either metabolic disease progression or treatment response . With the combination of reconstruction protocols evaluated in this study, a hotspot would be incorrectly classified nearly 4% of the time.
The use of such a conservative threshold (i.e. 30%) is a consequence of the intrinsic variability in repeat PET scans, biological variability and the need to account for inter-scanner variability and aims to reduce the number of incorrectly classified responders, albeit at the cost of sensitivity. The adoption of a methodology such as SUVref may enable the use of a less conservative threshold, by reducing the need to accommodate for inter-scanner variability, thus increasing sensitivity without increasing the number of incorrectly classified responders.
The combination of SUVref and SUVpeak in SUVref,peak results in a further reduction in the percentage of incorrectly classified lesions (0.7%). This is due to the additional smoothing inherent in the calculation of the peak value.
The sensitivity of the SUVref methodology to SUVref filter size was investigated using non-optimal filters. In both reconstruction protocol comparisons (PSF versus OSEM and TOF1 versus OSEM), the application of non-optimal filters reduced the improvement in quantitative comparability provided by the optimal SUVref filters as would be expected. Despite this, the improvement when compared to SUVmax was still significant. Given the non-optimal filter, sizes were used each 2 SDs closer together than the optimal filter sizes, the chance of such suboptimal filters being selected by chance is very small, particularly if multiple phantom acquisitions are performed for filter selection (for instance, three repeats are recommended in the NEMA Standard ).
Considering the difference in resolution uniformity within the transaxial field of view with PSF-based reconstructions versus traditional OSEM, the effect of hotspot location was assessed. In the comparison of medial (< 75 mm from centre of transaxial FOV) versus lateral lesions (≥75 mm from centre of transaxial FOV), no significant difference in the distribution of percentage differences for either SUVmax of SUVref was observed.
In addition to reducing the variation in quantification of uptake for individual hotspots across different reconstruction protocols, SUVref also significantly reduces the variation in assessments of change in uptake when both the baseline and follow-up scans are reconstructed using the same protocol. This in turn reduces the likelihood that the assessment of response for a given patient would differ between sites purely as a result of differences in reconstruction protocol.
While this study has evaluated the ability of SUVref to reduce reconstruction-dependent variation in SUV, similar performance would be expected for scanner-dependent variation since this would also manifest mainly as a difference in RC.
It is also worth noting that an alternative solution could be to reconstruct the image with two protocols, one optimised for visual review and the other conforming to the EANM guidelines. However, the SUVref methodology has the advantage of avoiding the additional burden of reconstructing, storing and reviewing a second version of every data set.
SUVref significantly reduces reconstruction-dependent variation in SUV measurements, while preserving the benefits of improved image quality through advances in reconstruction and scanner technology. This reduction in variation provides increased confidence in quantitative comparison of clinical images for monitoring treatment response or disease progression.
The authors would like to thank Vitaliy Rappoport for providing the phantom data, Richard Powers for providing the clinical data, and Mike Casey, Timor Kadir, Kevin Hakl and Bernard Bendriem for useful discussions.
- Wahl RL, Jacene H, Kasamon Y, Lodge MA, From RECIST to PERCIST: Evolving Considerations for PET Response Criteria in Solid Tumors. J Nucl Med 2009, 50: 122S-150S. 10.2967/jnumed.108.057307PubMed CentralPubMedView ArticleGoogle Scholar
- Huang H: Anatomy of SUV. Nucl Med and Biol 2000, 27: 643–646. 10.1016/S0969-8051(00)00155-4View ArticleGoogle Scholar
- Jaskowiak CJ, Bianco JA, Perlman SB, Fine JP: Influence of Reconstruction Iterations on 18 F-FDG PET/CT Standardized Uptake Values. J Nucl Med 2005, 46: 424–428.PubMedGoogle Scholar
- Boellaard R, O'Doherty MJ, Weber WA, Mottaghy FM, Lonsdale MN, Stroobants SG, Oyen WJG, Kotzerke J, Hoekstra OS, Pruim J, Marsden PK, Tatsch K, Hoekstra CK, Visser EP, Arends B, Verzijlbergen FJ, Zijlstra JM, Comans EFI, Lammertsma AA, Paans AM, Willemsen AT, Beyer T, Bockisch A, Schaefer-Prokop C, Delbeke D, Baum RP, Chiti A, Krause BJ: FDG PET and PET/CT: EANM procedure guidelines for tumour PET imaging: version 1.0. Eur J Nucl Med Mol Imaging 2010, 37: 181–200. 10.1007/s00259-009-1297-4PubMed CentralPubMedView ArticleGoogle Scholar
- Boellaard R, Oyen WJG, Hoekstra CJ, Hoekstra OS, Visser EP, Willemsen AT, Arends B, Verzijlbergen FJ, Zijlstra J, Paans AM, Comans EF, Pruim J: The Netherlands protocol for standardisation and quantification of FDG whole body PET studies in multi-centre trials. Eur J Nucl Med Mol Imaging 2008, 35: 2320–2333. 10.1007/s00259-008-0874-2PubMedView ArticleGoogle Scholar
- National Electrical Manufacturers Association. NEMA Standards Publication NU 2–2007. Performance Measurements of Positron Emission Tomographs NEMA 2007.Google Scholar
- Weber WA, Figlin R: Monitoring cancer treatment with PET/CT: Does it make a difference? J Nucl Med 2007, 48: 36S-44S.PubMedView ArticleGoogle Scholar
- Joshi A, Koeppe RA, Fessler JA: Reducing between scanner differences in multi-centre PET studies. NeuroImage 2009, 49: 154–159.View ArticleGoogle Scholar
- Kadrmas DJ, Casey ME, Conti M, Jakoby BW, Lois C, Townsend DW: Impact of Time-of-Flight on PET Tumor Detection. J Nucl Med 2009, 50: 1315–1323. 10.2967/jnumed.109.063016PubMed CentralPubMedView ArticleGoogle Scholar
- Panin V, Kehren F, Michel C, Casey M: Fully 3-D PET Reconstruction with system matrix derived from point source measurements. IEEE Trans Med Imaging 2007, 25: 907–921.View ArticleGoogle Scholar
- Young H, Baum R, Cremerius U, Herholz K, Hoekstra O, Lammertsma AA, Pruim J, Price P: Measurement of Clinical and Subclinical Tumour Response using [ 18 F]-fluorodeoxyglucose and Positron Emission Tomography: Review and 1999 EORTC Recommendations. Eur J Cancer 1999, 35: 1773–1782. 10.1016/S0959-8049(99)00229-4PubMedView ArticleGoogle Scholar
- Kadrmas DJ, Casey ME, Conti M: Impact of Time-of-Flight on PET Tumour Detection. J Nucl Med 2009, 50: 1315–1323. 10.2967/jnumed.109.063016PubMed CentralPubMedView ArticleGoogle Scholar
- Boellaard R, Krak N, Hoekstra OS, Lammertsma AA: Effects of Noise, Image Resolution, and ROI Definition on the Accuracy of Standard Uptake Values: A Simulation Study. J Nucl Med 2004, 45: 1519–1527.PubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.