Open Access

A method for accurate spatial registration of PET images and histopathology slices

  • Tanuj Puri1, 2,
  • Anastasia Chalkidou1,
  • Rhonda Henley-Smith3,
  • Arunabha Roy1,
  • Paul R. Barber4, 5,
  • Teresa Guerrero-Urbano6,
  • Richard Oakley7,
  • Ricard Simo7,
  • Jean-Pierre Jeannon7,
  • Mark McGurk7,
  • Edward W. Odell3,
  • Michael J. O’Doherty1 and
  • Paul K. Marsden1Email author
Contributed equally
EJNMMI Research20155:64

DOI: 10.1186/s13550-015-0138-7

Received: 28 August 2015

Accepted: 16 October 2015

Published: 14 November 2015

Abstract

Background

Accurate alignment between histopathology slices and positron emission tomography (PET) images is important for radiopharmaceutical validation studies. Limited data is available on the registration accuracy that can be achieved between PET and histopathology slices acquired under routine pathology conditions where slices may be non-parallel, non-contiguously cut and of standard block size. The purpose of this study was to demonstrate a method for aligning PET images and histopathology slices acquired from patients with laryngeal cancer and to assess the registration accuracy obtained under these conditions.

Methods

Six subjects with laryngeal cancer underwent a 64Cu-copper-II-diacetyl-bis(N4-methylthiosemicarbazone) (64Cu-ATSM) PET computed tomography (CT) scan prior to total laryngectomy. Sea urchin spines were inserted into the pathology specimen to act as fiducial markers. The specimen was fixed in formalin, as per standard histopathology operating procedures, and was then CT scanned and cut into millimetre-thick tissue slices. A subset of the tissue slices that included both tumour and fiducial markers was taken and embedded in paraffin blocks. Subsequently, microtome sectioning and haematoxylin and eosin staining were performed to produce 5-μm-thick tissue sections for microscopic digitisation. A series of rigid registration procedures was performed between the different imaging modalities (PET; in vivo CT—i.e. the CT component of the PET-CT; ex vivo CT; histology slices) with the ex vivo CT serving as the reference image. In vivo and ex vivo CTs were registered using landmark-based registration. Histopathology and ex vivo CT images were aligned using the sea urchin spines with additional anatomical landmarks where available. Registration errors were estimated using a leave-one-out strategy for in vivo to ex vivo CT and were estimated from the RMS landmark accuracy for histopathology to ex vivo CT.

Results

The mean ± SD accuracy for registration of the in vivo to ex vivo CT images was 2.66 ± 0.66 mm, and the accuracy for registration of histopathology to ex vivo CT was 0.86 ± 0.41 mm. Estimating the PET to in vivo CT registration accuracy to equal the PET-CT alignment accuracy of 1 mm resulted in an overall average registration error between PET and histopathology slices of 3.0 ± 0.7 mm.

Conclusions

We have developed a registration method to align PET images and histopathology slices with an accuracy comparable to the spatial resolution of the PET images.

Keywords

Histopathology PET Registration Methodology Oncology

Background

Positron emission tomography (PET) is a molecular imaging technique used for the visual and quantitative assessment of a tissue of interest via administration of a radiopharmaceutical tracer. The validation of a new tracer can be achieved by comparing the tracer uptake seen in PET images with the gold standard of histopathology imaging. Once validated, the new tracer can then be used to provide information about diagnosis, prognosis and response to treatment. Due to the heterogenous nature of tumours and the consequent heterogenous distribution of tracer uptake [1], the validation of PET against histopathology images can only be considered meaningful if spatially corresponding regions are compared.

The process of spatially aligning multi-modal image data sets is challenging and is usually achieved using anatomical landmarks, features and/or pixel intensity values to establish correspondences between images acquired with different modalities. The registration between in vivo human tomographic images and three-dimensional (3D) histopathology data in the brain has been shown to obtain satisfactory results with submillimetre accuracy [2, 3]. However, the process of obtaining 3D reconstructions of the whole histopathology specimen is laborious, expensive and not feasible in most routine pathology settings. The post processing for such an approach includes (a) registration of individual histopathology slices to block-face images (photographic images of the specimen taken before and after cutting) to correct for the shrinkage incurred during histopathology procedures [4], (b) registration of shrinkage-corrected histopathology slices to each other to reconstruct a 3D volume [5, 6] and (c) registration of the histopathology volume to the in vivo imaging data (i.e. in vivo PET/computed tomography (CT)/MR) using intensity-based or other algorithms directly [2]. In some cases, the in vivo imaging and histology volume are registered using volumetric block-face images as the registration reference [3] due to the latter’s rich spatial information content. However, the 3D reconstruction of block-face images can be distorted by the so-called ‘banana effect’ whereby a 3D curved object cannot be reconstructed from cross-sections without any additional information [7]. It is possible to minimise related registration errors by using an additional intermediate tomographic scan, for example, CT or MRI, of the unsliced specimen (i.e. an ex vivo scan) with inserted fiducial markers that can be visualised on both ex vivo and block-face images to drive the reconstruction of the 3D block-face volume [4]. Shojaii R. et al. [8] used a catheter filled with cuttlefish ink and flour as a fiducial marker that was visible in multi-modal images. A number of other markers have also been proposed, for example, cotton thread infused with solution of gadopentetate dimeglumine and blue tissue marking dye [9], plastic sheaths of catheter needles [10], cotton thread infused with a solution of Magnevist and blue tissue marking dye [11] and bronze and stainless-steel paints [12]. However, most of these markers/studies are MRI specific.

In addition, the use of systematic sectioning of the specimen, to obtain millimetre-thick tissue slices, simplifies the cutting of parallel and consecutive slices [9], as opposed to using a freehand technique. Mega et al. [13] registered stained whole-brain sections to pre-mortem PET images in Alzheimer’s disease, however, no registration errors were reported. Edwards et al. [14] presented a system for PET-to-histology registration for image-guided surgery but did not report any registration errors. A few other studies involved the registration of histology with autoradiographs in preclinical settings [3, 1518] and/or histology with MRI [2, 9, 12, 1921].

Parallel sectioning of the specimen provides good thickness estimates of the sectioned slices, contiguous sectioning aids in minimising the errors in reconstructing the 3D histopathology volume and whole-tissue histopathology slices provide confidence in matching boundaries with block-face/in vivo/ex vivo data. However, registration of non-parallel, non-contiguously cut and non-whole-sized histopathology slices to, for example, tomographic PET slices is more difficult, particularly in regard to identifying corresponding slices in the axial (i.e. perpendicular to the cutting plane) direction. Because the PET and CT data are inherently 3D and the histology slices are inherently two dimensional (2D), an important aspect of the PET and ex vivo CT to histology registration is the identification of corresponding z-axis levels. The difficulty in identifying the z-axis accurately emerges from the lack of a 3D reconstruction of the specimen volume after slicing. Although the specimen is cut into consecutive slices, standard pathology procedures do not involve the use of a system that ensures all slices are cut to exactly the same thickness. As a consequence, a histology slice might not be cut perpendicular to the z-axis of the specimen and different areas of the micron-thick histology data could belong to different millimetre-thick slices.

Therefore, the aim of this work was to develop a registration methodology for an accurate spatial alignment between PET/CT images of the head and neck region in humans and histopathology slices obtained in routine pathology settings where slices may be not perfectly parallel, non-contiguously cut and non-whole-slice sized.

Methods

Subjects

Eligible patients for this prospective study were identified at the head and neck oncology multidisciplinary meetings and recruited from the head and neck oncology clinic at Guy’s and St Thomas’ Hospital. Patients were eligible to take part if they were scheduled to undergo total laryngectomy with or without lymph node dissection. Staging of the tumours was performed according to the TNM staging system. From March 2011 to December 2012, eight consecutive patients were prospectively enrolled into the study. They were all patients with advanced-stage HNSCC laryngeal cancer, and six patients were included in the final analysis. Two patients were excluded as they did not undergo a 64Cu-ATSM PET/CT scan—one due to changes in his clinical management and one due to declining to complete the scan after recruitment. The specific patient and tumour characteristics for both cohorts are summarised in Table 1.
Table 1

Patient and tumour characteristics

Patient ID

Age

TNM

Surgery

P1

66

T4N2cM0

Total laryngectomy and bilateral neck dissection

P2

62

T3N2cM0

Total laryngectomy and bilateral neck dissection

P3

65

T4aN3M0

Total laryngectomy and bilateral neck dissection

P4

70

T4aN2bM0

Total laryngectomy and bilateral neck dissection

P5

73

T4N2bM0

Total pharyngolaryngectomy and bilateral neck dissection

P6

75

T4N0M0

Total laryngectomy and bilateral selective neck dissection

All lesions were histopathologically confirmed based on biopsy results. In total, eight lesions (six primary tumours and two lymph nodes) were identified as disease positive. The study was approved by the London Bridge Research Ethics Committee (reference 07/Q0704/8, 1/2011). All patients signed an informed consent form agreeing to participate in the study and to publication of results. A copy of the study protocol can be found by following the link [22].

Study design

The registration framework followed in this study is shown in Fig. 1, and imaging parameters are outlined in Table 2. Each of the steps is explained in detail as follows:
Fig. 1

Registration framework. The various steps in the registration methodology framework applied in this study. PET positron emission tomography, CT computed tomography, H&E haematoxylin and eosin

Table 2

Summary of imaging parameters

Imaging modality

In-plane reconstruction FOV (mm)

Pixel size in XYZ (mm)

3D or 2D

PET

500

3.91 × 3.91 × 3.27

3D

CT in vivo

700

1.37 × 1.37 × 3.27

3D

CT ex vivo

Specimen fit (approximately few cm)

0.71 × 0.71 × 1.00

3D

Block face

Specimen fit (approximately few cm)

0.25 × 0.25

2D

Histology

Specimen fit (approximately 2 cm)

0.00134 × 0.00134

2D

FOV field of view, XYZ x-axis, y-axis and z-axis, respectively

PET-CT scanning

The 64Cu-copper-II-diacetyl-bis(N4-methylthiosemicarbazone) (64Cu-ATSM) PET computed tomography (CT) scans were acquired a week before the surgery on a PET/CT GE VCT scanner (General Electric Medical Systems, Waukesha, WI, USA) with 500-mm axial field of view (FOV) and spatial resolution of 6-mm full-width-at-half-maximum (FWHM) [23]. Subjects were scanned in fasting state and positioned supine, arms down wi th knee support such that the tumour site was in the centre of the FOV. Administered was 600 MBq of 64Cu-ATSM, a putative marker of tissue hypoxia, followed by a low-dose CT scan and a 10-min PET scan 70 min post-injection. The patient’s head was fixed firmly but comfortably to minimise movement during the PET-CT scan using the standard scanner headrest. Five out of six PET data sets were reconstructed using the three-dimensional (3D) re-projection algorithm and one data set using the proprietary GE 3D-‘Viewpoint’ algorithm. All PET images were corrected for radioactive decay and attenuation corrected using CT.

Fiducial markers

The logistics and feasibility of using spines of black sea urchin as fiducial markers in human specimens were first tested ex vivo. Markers were tested for length and diameter, insertion into a specimen, ease of cutting with minimal tissue tearing and visibility in histopathological sections. The spines consist of calcium carbonate (CaCO3) and magnesium carbonate (MgCO3), and they are therefore visible during CT scanning [24]. Spines of length 20 to 30 mm and diameter 0.5 mm (approximately) (Fig. 2a) were inserted into the specimen using a 20-gauge and 3.5-in. Quincke spinal needle (Fig. 2b) with stylet and cannula hubs (Becton, Dickinson and Company, Rutherford, New Jersey, USA). The spines were pushed into the fresh specimen using the stylet, and the cannula was retracted at the same time such that the spine remained in the desired tumour location where the needle was initially inserted. Spines were inserted at angles to each other (typically ~30°) in order to facilitate slice identification (see below). Figure 2a shows the appearance of a spine on a haematoxylin and eosin (H&E)-stained histopathology slice at a spatial resolution of 1 μm/pixel. The spines were also visible on ex vivo CT and block-face images (Fig. 3). For technical reasons, only four out of six specimens were inserted with fiducial markers and so were able to be registered with PET.
Fig. 2

Sea urchin spine fiducial markers. a Example of a 5-μm-thick tissue section showing a sea urchin spine in the transverse plane in a haematoxylin and eosin (H&E)-stained histopathology slice at a spatial resolution of 1 μm/pixel. b 20-gauge spinal needle loaded with the sea urchin spine fiducial marker. The tip of the spine can be seen protruding from the needle (red arrow)

Fig. 3

Laryngeal pathology specimen. Example of a laryngeal pathology specimen from a patient with advanced laryngeal cancer that was included in the study. The exact anatomical orientation (left to right and top to bottom) and the consecutive cutting of the samples are displayed, as recorded at the time of the slicing by the pathology lab staff

Specimen fixation and ex vivo CT scanning

The specimen was fixed in 10 % formalin for 24 h after marker insertion. Block-face images of the whole specimen were obtained before and after fixation using an optical/digital camera (Nikon Coolpix 995, Nikon, Japan). The block-face images served as visual reference for the registration process. The specimen was then scanned ex vivo on the CT component of a SPECT-CT scanner (Philips Precedence 16, Eindhoven, Netherlands) with careful positioning such that the orientation differences between in vivo and ex vivo CT scans of the larynx were minimised.

Specimen slicing and block-face imaging

The larynx specimen was sliced into ~5-mm thick slices using a bandsaw (Exakt saw, Norderstedt, Germany) with a blade thickness of 300 μm. The average ± SD thickness of all the slices (excluding first and last slice) from five specimens was 5.28 ± 2.42 mm. Tissue slices from every specimen were laid out on a flat glass table lit with luminous white light (from above and underneath) to obtain a high-contrast image of both sides. The camera position was fixed above the table such that all tissue slices of a specimen were captured in a single shot.

Histopathology procedure and microscopic digitisation

One or more subsections of every 5-mm-thick tissue slice that included tumour and fiducial markers were cut and embedded in paraffin blocks followed by microtome cutting. Microtome cutting results in the production of 5-μm-thick tissue slices that are subsequently attached to a glass slide of size 30 × 21 mm and stained with H&E. Finally, they were digitised using a light microscope (Lister ‘Open’ Microscope, CRUK/MRC Oxford Institute for Radiation Oncology, Oxford, UK). The microscope is based on a TE200 body with a ×4 (NA 0.16) air objective lens (Nikon, UK) and comprises a 3-CCD colour camera (KY-F75U, JVC UK), motorised stage (Scan IM 120 × 100, Marzhauser, Germany) and in-house written software [25]). The in-plane FOV of the microscope was set to acquire the whole slide in multiple stages at a spatial resolution of 1 μm/pixel, and individual images were stitched together with 5 % overlapping such that the edges matched and became invisible. A total of twenty-three 5-μm-thick histopathology slices were obtained from six laryngeal specimens (eighteen 5-μm-thick slices belonged to the four specimens with sea urchin spine fiducials inserted). Of the twenty-three slices, two slices had 4 fiducial markers each, six slices had 3 markers each, five slices had 2 markers each, one slice had 1-marker and nine slices had no marker. Figure 4 shows the thickness differences between the imaging and 3D histopathology data and the final 5-μm-thick tissue slices.
Fig. 4

Slicing of excised specimen. A schematic diagram showing (left) the excised specimen, (centre) a ~5-mm-thick tissue slice and (right) a 5-μm-thick tissue slice that has been stained. A relevant section is taken from the 5-mm slice which is then embedded in paraffin prior to microtome cutting to obtain the 5-μm-thick tissue slices

Image registration procedures

A series of four rigid image registration steps, described in detail below, was performed to align PET images and histopathology slices. The ex vivo CT was used as the reference image such that PET, in vivo CT, ex vivo CT and histopathology were all in this same space after alignment. All registrations were performed using PMOD software (PMOD Technologies Ltd., Zurich, Switzerland).

Step 1—registration of PET to in vivo CT

PET and in vivo CT images are both acquired as part of the combined PET-CT scan. This step was performed using 3D rigid registration with a normalised mutual information objective and visually checked by a clinician (AC—6 years clinical oncology and 4 years PET/CT experience).

Step 2—registration of in vivo CT to ex vivo CT

Thirteen anatomical landmarks were systematically identified on the thyroid and cricoid cartilage. These included the superior horns of the thyroid cartilage, the middle and posterior edges of the thyroid and cricoid cartilage, the superior thyroid notch and hyperdense areas where the cartilage was calcified and therefore easily identifiable. The landmarks were identified by a clinician (AC). Alignment was performed using a rigid point-based 3D registration procedure, and a transformation matrix was obtained for use in step 3. Figure 5 shows an example of an in vivo CT and the corresponding ex vivo CT of the pathology specimen.
Fig. 5

In vivo CT (left) and the corresponding ex vivo CT (right) of the pathology specimen. The ex vivo CT corresponds to the area outlined by the red box. Large deformations occurring due to the surgical excision can be seen

Step 3—transformation of PET to ex vivo CT

The transformation matrix obtained in step 2 was applied to the PET image (previously registered to in vivo CT) such that the new transformed PET was in spatial alignment with the ex vivo CT.

Step 4—registration of histology to ex vivo CT

As the fiducial markers are long spines, they can be seen in many planes of both the histology slices and the ex vivo CT images. A histology slice was selected, and the in-plane root mean square (RMS) distance between fiducials, and any additional visible anatomical landmarks (minimum of three in total), in the histology slice and a CT slice was calculated and minimised using a 2D rigid registration. The residual RMS inter-marker distance was then plotted as a function of the CT slice number whilst the histology slice was kept constant. As the spine fiducials are aligned non-parallel to each other, the RMS distance increases rapidly for non-corresponding slices as shown in Fig. 6. The CT slice for which the RMS distance is a minimum is deemed to be the one corresponding to the current histology slice. In order to better identify the slice with minimum RMS inter-marker distance, a negative Gaussian function (of the form ab.exp(−x 2/c 2) where x represents the CT slice number and a, b and c are fitted constants) was fitted to the inter-marker distance curves and the minimum point of the Gaussian was used as an estimate of the minimum inter-marker distance and the corresponding CT slice. This process was repeated for all other histology slices. In practice, the process described above was aided by careful documentation of the serial specimen cutting performed in the pathology department. The pathology department records precisely, as part of its diagnostic routine, the exact level where every tissue block is cut and collected from. This provides further detail of the z-level location with the help of images taken at the time of cutting the specimen into 5-mm slices (Fig. 3).
Fig. 6

Identification of corresponding CT planes and histology slices. Example showing how corresponding histology slices and (ex vivo) CT planes are identified. The RMS distance is calculated using either four spine fiducial markers (blue line) or four spine fiducial markers and one anatomical landmark (red line). Although there is approximate agreement between the two methods, the use of landmarks leads to more precise identification as the landmarks are often confined to one or two consecutive axial slices. Although the measurements using the fiducial markers only (blue line) leads to smaller RMSE, both methods lead to a very similar position of the global minimum. The CT slice that showed corresponding to the minimum RMSE was chosen as that corresponding with the given histopathology slice. RMSE root mean square error

Estimation of registration errors

Registration errors for PET and CT components of PET-CT

The error due to misalignment of the PET and CT components of the PET-CT scan was not measured and was assessed visually.

Registration errors for in vivo CT to ex vivo CT

The in vivo CT to ex vivo CT registration error was estimated using a ‘leave-one-out’ strategy as follows. The registration procedure described above was repeated 13 times leaving one pair of landmarks out each time to calculate 13 transformation matrices. Each left-out landmark on in vivo CT was then transformed using the corresponding transformation matrix. The distance between each transformed point and its corresponding point on the ex vivo CT was measured for each of the 13 cases. The error is then calculated as the average of all 13 values.

Registration errors for histology to ex vivo CT

Given the extended nature and small number of the fiducial markers, it was not possible to use a leave-one-out approach to estimate the histology to ex vivo CT registration error, and so, the error was approximated by the residual in-plane RMS inter-marker distance—note that this will not account for incorrectly matched histology and CT planes.

Total registration error

An estimate of the overall registration error between PET and histology was obtained by adding the three contributions (i.e. PET—in vivo CT; in vivo CT—ex vivo CT; ex vivo CT—histology) in quadrature.

Results

PET to in vivo CT co-registration

All of the PET-CT data sets obtained from the scanner appeared well aligned and could not be corrected any further with registration (Fig. 7). This is consistent with the registration error being attributable to the scanner PET-CT alignment only which has an accuracy of ~1.0 mm [26].
Fig. 7

Fused PET and CT components of PET-CT scan. Coronal view of fused co-registered PET and ex vivo CT data for patient number 4. Very good alignment between the two data sets can be observed by using the tracheostomy as a reference point

In vivo CT to ex vivo CT co-registration

Table 3 shows the results of in vivo CT to ex vivo CT registration error measurements. The average registration error between in vivo CT and ex vivo CT was 2.66 (SD: 0.66) mm.
Table 3

Registration accuracy

Subjects

CTin-CTex

CTex-histology

Total

P1-BH

NA

0.91

NA

P1-BJ

NA

1.86

NA

P1-BK

NA

1.52

NA

P2-B

NA

0.38

NA

P2-C

NA

0.92

NA

P3-BJ

3.55

1.08

3.71

P3-BH

3.55

0.58

3.60

P3-BK

3.55

0.11

3.55

P4-AA

2.83

0.8

2.94

P4-AB

2.83

0.85

2.95

P4-AC

2.83

0.97

2.99

P4-R

2.83

0.75

2.93

P5-M1

2.94

1.08

3.13

P5-M2

2.94

0.49

2.98

P5-S

2.94

1.14

3.15

P6-CC

1.84

1.09

2.14

P6-CD

1.84

0.89

2.04

P6-DB

1.84

0.50

1.91

P6-DC

1.84

0.62

1.94

P6-DD

1.84

0.83

2.02

Mean

2.66

0.86

2.80

SD

0.66

0.41

0.63

The table shows (columns from left to right) the subject number and corresponding histology samples, RMS registration error in millimetres resulting from landmark-based in vivo CT and ex vivo CT, RMS registration error in millimetres between histology and ex vivo CT and the total registration error between in vivo CT and histology calculated as square root of the sum of squares of the errors between individual steps. CTin computed tomography image obtained in vivo, CTex computed tomography image obtained ex vivo

Ex vivo CT to histology co-registration

Table 3 shows the results of the ex vivo CT to histology registration error measurements. The mean ± SD accuracy was 0.86 ± 0.41 mm (mm). Figure 6 shows an example of the procedure for determining corresponding histology slices and ex vivo CT planes. RMS distances were calculated using either spine fiducial markers only (blue line) or the spine fiducial markers and an anatomical landmark (red line) that can be visualised in both CT and histology slices. Although there is approximate agreement between the two methods, the use of additional landmarks leads to more accurate identification, i.e. as indicated by the plane with the minimum RMS error, as the landmarks are often confined to a single (or two consecutive) axial slices. Although the measurements using the fiducial markers only (blue line) lead to smaller root mean square error (RMSE), both methods lead to a very similar global minimum position.

Overall PET to histology error

The average total registration error between PET and histopathology slices, assuming a PET-CT alignment accuracy of 1 mm, was 3.0 ± 0.7 mm. An example of the registration result between PET and histopathology slices is shown in Fig. 8.
Fig. 8

Registered PET, ex vivo CT and histology images. (ac) show registered images of PET, ex vivo CT and histology from two different subjects. Regions in PET and ex vivo CT that correspond to histology are marked with a red outline. Yellow markers in (c) show the sea urchin spine markers that were clearly visible on the ex vivo CT and histology images

Discussion

We have developed and assessed a method for alignment of PET and histopathology slices obtained in routine pathology settings in six male larynxes with advanced HNSCC cancer. The average overall registration error between PET and histopathology was 3.0 ± 0.7 mm2 which is better than the 6.00-mm FWHM spatial resolution of the PET scanner.

One of the most challenging aspects of the process and one that future efforts should be focused on is the identification of the corresponding z-axis levels between the 2D histology and the 3D imaging data. When parallel consecutive slices are used, the slice thicknesses are accurately known and the identification of the z-axis can be performed by simple counting [27]. However, not all pathology departments have access to the equipment required, and the processing of these specimens would have to deviate from the local pathology laboratory routine. Contrary to previous attempts where the pathology routine had to be changed to introduce either whole-mount tissue sections or parallel consecutive slicing [27], the method outlined in this study affects the routine pathology workflow with the addition of one extra step, the insertion of the fiducial markers. This step, however, does not require extra personnel as it is not technically challenging and it can be performed easily by a member of the pathology team handling the specimen. In addition, it extends a procedure that has a total duration of many hours (from specimen removal after surgery to generation of tumour blocks for histopathology analysis) by few extra minutes only. For most routine pathology departments in which these kinds of study are performed, the pathologist performs parallel cutting with the use of a bandsaw, and the accuracy of this process depends on the experience of the pathologist and the tissue characteristics. With the use of optical images and the recorded anatomical information from the pathology records, we were able to identify the approximate level of each one of the tissue blocks on the ex vivo CT.

We employed sea urchin spines as fiducial markers which were clearly visible on both CT and histology images. The use of spines can add value for cases where bone tissue is absent.

‘Block-face’ images were obtained on both sides of the tissue blocks since tissues used for H&E staining were extracted from either side of the blocks and these images acted as a visual reference during registration. Even though block-face images are mainly used for shrinkage correction [4], the choice of rigid registration for this study obviated the exclusion of a histology-to-block-face step. However, as opposed to other organs, the lung for example [28], only small deformations occur inside the laryngeal cartilage area. An average shrinkage of 3 % before and after fixation has been calculated for the area included by the cartilage skeleton, which in most cases includes the tumour bulk [4]. This is because the larynx is an anatomical site with a strong and rigid skeleton, which helps to maintain the shape of the tissues inside it. In addition, it has been shown that the main shrinkage in the whole procedure occurs during the processing of the histological material to acquire the H&E sections from the thick slices and not from the fixation process [4]. Finally, excluding the use of block-face images avoided potential additional sources of error arising from (1) 3D volume reconstruction of block-face slices, (2) ex vivo CT to block-face registration and (3) histology to block-face registration.

Identification of reliable landmarks is challenging on PET, and therefore, the use of a PET-CT scanner was a major advantage. This is because an intermediate high-resolution ex vivo CT of the larynx specimen served as the reference data set that corresponded well with the in vivo CT data and also with the histopathology slice boundaries and/or edges. A disadvantage was the error due to PET-CT misalignment which was reported from literature and not measured, though the error introduced is likely to be small. A misalignment of ~1 mm may be expected in a worst case spatial calibration between PET and CT of the PET-CT scanner [29]. It was not possible to measure the PET-CT misalignment explicitly in this study; however, each PET-CT data set was visually verified by an expert clinician, and no further adjustment was deemed necessary in most of the data sets. Somer et al. [29] report an average PET-CT misalignment due to patient motion during the PET-CT scan as 5.4 mm; however, this figure was obtained primarily from measurement on the body and limbs and so is likely to greatly overestimate misalignments in the head and neck region. Nevertheless, further investigation of PET-CT misalignment would be useful, and the use of a rigid fixation device (e.g. a radiotherapy mask) may be advantageous.

Caldas-Magalhaes et al. [4] reported an average (in-plane) registration RMSE of 3.49 mm between PET and histopathology in laryngeal and hypopharyngeal cancer using a semi-automatic methodology, i.e. very similar to our overall error of 3.0 mm. Their histopathology samples were whole-mounted histology slices, obtained from a contiguously cut tissue block immersed into agarose medium whilst a meat-slicing machine was used for cutting. None of these methods are part of the routine pathology practice where usually only 30 × 21 mm slides are used and the specimen is sliced freehand without the provision of a supportive structure, such as the agarose medium. The carbon rods used as fiducial markers were not visible on histology, and therefore, manual landmarks were identified on the cartilage to drive the histology-to-block-face image registration. A study of the prostate by Park et al. [30] reported an average registration error of 7.7 mm between PET and histopathology using an in vivo MRI scan as the reference space. However, obtaining PET, CT and MR in vivo images may not be feasible in every clinical trial. Moreover, this study obtained contiguously cut 3-mm-thick parallel tissue slices with whole-mounted histology slices which again is not a routine pathology practice.

The current study suffers from a number of limitations. In particular, this is a specific case where tumour is surrounded by the larynx cartilage which prevents (in most cases) any unexpected deformation of the tumour during surgery, fixation and the slicing procedure.

Conclusions

We have presented a registration methodology for accurate alignment between PET and histopathology slices that can be performed in routine pathology settings and that demonstrates an accuracy better than the spatial resolution of the PET scanner.

Notes

Declarations

Acknowledgements

We would like to acknowledge King’s College London and UCL Comprehensive Cancer Imaging Centre, funded by CRUK and EPSRC in association with MRC and DoH (England). The authors thank the staff at the KCL Oral Pathology laboratory and King’s Health Partner’s Biobank at Guys’ Hospital and the PET Imaging Centre at St. Thomas’ Hospital for their excellent technical support. This research was supported by the National Institute for Health Research (NIHR) Biomedical Research Centre at Guy’s and St Thomas’ NHS Foundation Trust and King’s College London. The views expressed are those of the author(s) and not necessarily those of KCL, the NHS, the NIHR or the Department of Health.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Authors’ Affiliations

(1)
Division of Imaging Sciences and Biomedical Engineering, King’s College London
(2)
Present address: Department of Oncology, University of Oxford
(3)
Oral Pathology Department, King’s College London
(4)
Department of Oncology, Cancer Research UK and Medical Research Council Oxford Institute for Radiation Oncology, University of Oxford
(5)
Institute for Mathematical and Molecular Biomedicine, King’s College London
(6)
Department of Clinical Oncology, Guy’s & St Thomas’ NHS Foundation Trust
(7)
Department of Head & Neck Surgery, Guy’s & St Thomas’ NHS Foundation Trust

References

  1. Gerlinger M, Rowan AJ, Horswell S, Larkin J, Endesfelder D, Gronroos E, et al. Intratumor heterogeneity and branched evolution revealed by multiregion sequencing. N Engl J Med. 2012;366(10):883–92. doi:10.1056/NEJMoa1113205.View ArticlePubMedGoogle Scholar
  2. Ceritoglu C, Wang L, Selemon LD, Csernansky JG, Miller MI, Ratnanather JT. Large deformation diffeomorphic metric mapping registration of reconstructed 3D histological section images and in vivo MR images. Front Hum Neurosci. 2010;4:43. doi:10.3389/fnhum.2010.00043.PubMed CentralPubMedGoogle Scholar
  3. Dauguet J, Delzescaux T, Condé F, Mangin J-F, Ayache N, Hantraye P, et al. Three-dimensional reconstruction of stained histological slices and 3D non-linear registration with in-vivo MRI for whole baboon brain. J Neurosci Methods. 2007;164(1):191–204.View ArticlePubMedGoogle Scholar
  4. Caldas-Magalhaes J, Kasperts N, Kooij N, van den Berg CAT, Terhaard CHJ, Raaijmakers CPJ, et al. Validation of imaging with pathology in laryngeal cancer: accuracy of the registration methodology. Int J Radiat Oncol Biol Phys. 2012;82(2):e289–98.View ArticlePubMedGoogle Scholar
  5. Ourselin S, Roche A, Subsol G, Pennec X, Ayache N. Reconstructing a 3D structure from serial histological sections. Image Vis Comput. 2001;19(1–2):25–31.View ArticleGoogle Scholar
  6. Schwier M, Böhler T, Hahn HK, Dahmen U, Dirsch O. Registration of histological whole slide images guided by vessel structures. J Pathology Info. 2013. doi:10.4103/2153-3539.109868.Google Scholar
  7. Malandain G, Bardinet E, Nelissen K, Vanduffel W. Fusion of autoradiographs with an MR volume using 2-D and 3-D linear transformations. NeuroImage. 2004;23(1):111–27.View ArticlePubMedGoogle Scholar
  8. Shojaii R, Martel AL, editors. Multi-modality fiducial marker for validation of registration of medical images with histology, SPIE medical imaging; international society for optics and photonics. 2010.Google Scholar
  9. Ward AD, Crukley C, McKenzie CA, Montreuil J, Gibson E, Romagnoli C, et al. Prostate: registration of digital histopathologic images to in vivo MR images acquired by using endorectal receive coil. Radiology. 2012;263(3):856–64. doi:10.1148/radiol.12102294.View ArticlePubMedGoogle Scholar
  10. Hughes C, Rouviere O, Mege-Lechevallier F, Souchon R, Prost R, editors. A novel method for 3D prostate MR-histology registration using anatomical landmarks. 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO). 2012:2591-2595. IEEE Computer Soc. Los Alamitos, USA.Google Scholar
  11. Gibson E, Crukley C, Gaed M, Gómez JA, Moussa M, Chin JL, et al. Registration of prostate histology images to ex vivo MR images via strand-shaped fiducials. J Magn Reson Imaging. 2012;36(6):1402–12. doi:10.1002/jmri.23767.View ArticlePubMedGoogle Scholar
  12. McGrath DM, Vlad RM, Foltz WD, Brock KK. Technical note: fiducial markers for correlation of whole-specimen histopathology with MR imaging at 7 tesla. Med Phys. 2010;37:2321.View ArticlePubMedGoogle Scholar
  13. Mega MS, Chen SS, Thompson PM, Woods RP, Karaca TJ, Tiwari A, et al. Mapping histology to metabolism: coregistration of stained whole-brain sections to premortem PET in Alzheimer’s disease. NeuroImage. 1997;5(2):147–53.View ArticlePubMedGoogle Scholar
  14. Edwards PJ, Nijmeh AD, McGurk M, Odell E, Fenlon MR, Marsden PK, et al. Validation of PET imaging by alignment to histology slices. Medical image computing and computer-assisted intervention–MICCAI 2005. Berlin: Springer; 2005. p. 968–75.View ArticleGoogle Scholar
  15. Axente M, He J, Bass CP, Hirsch JI, Sundaresan G, Zweit J, et al. Comprehensive approach to coregistration of autoradiography and microscopy images acquired from a set of sequential tissue sections. J Nucl Med. 2011;52(10):1621–9.View ArticlePubMedGoogle Scholar
  16. McCall KC, Humm JL, Bartlett R, Reese M, Carlin S. Copper-64-diacetyl-bis (N (4)-methylthiosemicarbazone) pharmacokinetics in FaDu xenograft tumors and correlation with microscopic markers of hypoxia. Int J Radiat Oncol Biol Phys. 2012;84(3):e393–9.PubMed CentralView ArticlePubMedGoogle Scholar
  17. Takasawa M, Beech JS, Fryer TD, Jones PS, Ahmed T, Smith R, et al. Single-subject statistical mapping of acute brain hypoxia in the rat following middle cerebral artery occlusion: a microPET study. Exp Neurol. 2011;229(2):251–8.View ArticlePubMedGoogle Scholar
  18. Alic L, Haeck JC, Bol K, Klein S, van Tiel ST, Wielepolski PA, et al. Facilitating tumor functional assessment by spatially relating 3D tumor histology and in vivo MRI: image registration approach. PLoS One. 2011;6(8), e22835.PubMed CentralView ArticlePubMedGoogle Scholar
  19. Hughes C, Rouviere O, Mege Lechevallier F, Souchon R, Prost R, editors. Robust alignment of prostate histology slices with quantified accuracy. 2012.Google Scholar
  20. Rusu M, Golden T, Wang HB, Gow A, Madabhushi A. Framework for 3D histologic reconstruction and fusion with in vivo MRI: Preliminary results of characterizing pulmonary inflammation in a mouse model. Medical Physics. 2015;42:4822–4832.View ArticlePubMedGoogle Scholar
  21. Ou Y, Shen D, Feldman M, Tomaszewski J, Davatzikos C, editors. Non-rigid registration between histological and MR images of the prostate: a joint segmentation and registration framework. 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops 2009). IEEE; New York, USA. 2009:188–195.Google Scholar
  22. Cancer Research UK Clinical Trial Listing. http://www.cancerresearchuk.org/about-cancer/trials/a-study-looking-new-injection-pet-ct-scans-people-advanced-cancer-head-and-neck.
  23. Teras M, Tolvanen T, Johansson JJ, Williams JJ, Knuuti J. Performance of the new generation of whole-body PET/CT scanners: discovery STE and discovery VCT. Eur J Nucl Med Mol Imaging. 2007;34(10):1683–92. doi:10.1007/s00259-007-0493-3.View ArticlePubMedGoogle Scholar
  24. Moureaux C, Pérez-Huerta A, Compère P, Zhu W, Leloup T, Cusack M, et al. Structure, composition and mechanical relations to function in sea urchin spine. J Struct Biol. 2010;170(1):41–9.View ArticlePubMedGoogle Scholar
  25. Barber PR, Tullis IDC, Pierce GP, Newman RG, Prentice J, Rowley MI, et al. The Gray Institute ‘open’ high-content, fluorescence lifetime microscopes. J Microsc. 2013;251(2):154–67. doi:10.1111/jmi.12057.PubMed CentralView ArticlePubMedGoogle Scholar
  26. Thomas CM, Pike LC, Hartill CE, Baker S, Woods E, Convery DJ, et al. Specific recommendations for accurate and direct use of PET-CT in PET guided radiotherapy for head and neck sites. Med Phys. 2014. doi:10.1118/1.4867856.PubMed CentralGoogle Scholar
  27. Raleigh JA, Calkins-Adams DP, Rinker LH, Ballenger CA, Weissler MC, Fowler WC, et al. Hypoxia and vascular endothelial growth factor expression in human squamous cell carcinomas using pimonidazole as a hypoxia marker. Cancer Res. 1998;58(17):3765–8.PubMedGoogle Scholar
  28. Stroom J, Blaauwgeers H, van Baardwijk A, Boersma L, Lebesque J, Theuws J, et al. Feasibility of pathology-correlated lung imaging for accurate target definition of lung tumors. Int J Radiat Oncol Biol Phys. 2007;69(1):267–75. doi:10.1016/j.ijrobp.2007.04.065.View ArticlePubMedGoogle Scholar
  29. Somer EJ, Benatar NA, O’Doherty MJ, Smith MA, Marsden PK. Use of the CT component of PET-CT to improve PET-MR registration: demonstration in soft-tissue sarcoma. Phys Med Biol. 2007;52(23):6991–7006. doi:10.1088/0031-9155/52/23/015.View ArticlePubMedGoogle Scholar
  30. Park H, Meyer CR, Wood D, Khan A, Shah R, Hussain H, et al. Validation of automatic target volume definition as demonstrated for 11C-choline PET/CT of human prostate cancer using multi-modality fusion techniques. Acad Radiol. 2010;17(5):614–23.PubMed CentralView ArticlePubMedGoogle Scholar

Copyright

© Puri et al. 2015