Plexiglas cubes containing FM
The FM were composed of four sources of germanium-68 (74 kBq; diameter, 1 mm; and length, 0.5 mm; Isotop Product Laboratories, Valencia, CA, USA) originally designed for PET-CT co-registration, included in the center of four Plexiglas cubes of 1 × 1 × 1 cm. A spot of 2 mm diameter was drawn with standard white liquid corrector (Tipp-Ex®, Bic, Clichy, France) on top of each Plexiglas cube, exactly above the 68Ge sources. The cubes were then glued permanently to a custom made transparent Plexiglas mouse supporting plate at four corners close to the position of the mouse on the plate (Figure 1A).
Animal experiments
Animal experiments were performed under an animal use and care protocol approved by the animal ethics committee and conducted in accordance with Directive 2010/63/EU of the European Parliament. Six female nude mice (body weight of approximately 25 g) were obtained from Elevage Janvier (Le Genest Saint Isle, France) and received a subcutaneous injection in the flank of 106 PC12-multiple endocrine neoplasis syndrome type 2A (MEN2A) cells [20]. The mice were anesthetized by continuous gaseous anesthesia (1–2% isoflurane in O2) and imaged sequentially by fDOT and PET. The near-infrared (NIR) fluorescent dye Sentidye® (20 nmol; Fluoptics, Grenoble, France) was injected 3 h before starting the fDOT acquisition at a volume of 100 μL. FDG (7,400 kBq in 100 μL; Flucis, IBA, France) was administered 1 h before the PET scan. Each mouse underwent a 20-min fDOT acquisition followed by a 30-min PET acquisition. The anesthetized mice were transferred from the fDOT to PET scanner by means of the mouse supporting plate, while great care was taken to avoid movement of the animal in regard to its support. The contact of the ventral side of a nude mouse with the Plexiglas surface of the mouse holder is sticky enough to ensure that the mouse is not moving when transferred between scanners located at the same room.
Acquisition of the optical images
Images were acquired in the 3-D optical imager TomoFluo3-D (Cyberstar, Grenoble, France) [7]. To obtain the position of the FM, two optical images covering both the subject and the FM were acquired with the mouse placed in prone position: (1) a planar white light image recorded from a camera snapshot yielding the x and y coordinates (Figure 1B), and (2) an image of the 3-D surface of the animal, acquired by rapid consecutive camera shootings during axial scanning with an inclined green planar laser of the TomoFluo3-D, yielding the z coordinates (Figure 1C). One image was recorded for each laser position during laser scanning of the animal in the axial direction, and all images were then combined into a single image [7]. A surface image of the animal was then reconstructed from the intersection curve between the surface of the animal and the surface of the supporting plate by triangulation [7].
The fDOT image was obtained by a 20-min scan of a defined volume of interest covering the tumor using excitation by a 680-nm laser on the anterior side of the animal [7] and recording with a CCD camera fixed above its dorsal side. The scanning grid consisted of 7 × 6 sources in steps of 2 mm, and the detection area was 15 × 13 mm2. A 2 × 2 binning was applied, and the mesh volume corresponding to the detection area was mathematically discretized in voxels of 0.67 × 0.67 × 1 mm3 size to build the reconstruction mesh volume. Finally, the inverse problem of the tomographic reconstruction was solved with the algebraic reconstruction technique [7].
PET image acquisition
A 30-min scan was acquired in a Focus 220 MicroPET scanner (Siemens, Knoxville, TN, USA). Image acquisition and reconstruction used the MicroPET Manager Software (Siemens-Concorde Microsystems) based on a filtered back-projection algorithm. The attenuation correction was based on the segmentation of the emission map [21]; the dimensions of reconstruction volumes were 256 × 256 × 95 with a voxel size of 0.475 × 0.475 × 0.796 mm3. The counts were decay-corrected and expressed in Bq/cm3.
Image co-registration
As the three optical images (white light image, surface image and fDOT reconstruction) were acquired in the same spatial referential, the transformation matrix between the fDOT image and the white light image T
fDOT−photo
is calculated using the intrinsic parameters of fDOT. Hence, the T
fDOT-PET
transformation matrix for fDOT to PET co-registration is a product of T
fDOT-photo
and T
photo-PET
:
(1)
The co-registration (T
photo-PET
) method was processed in four steps:
-
1.
Detection of the optical planar (x, y) FM coordinates.
The Tipp-Ex® spot drawn on the top of each Plexiglas cube helped visualize the planar position of the FM in optical images. Four square-shaped regions of detection (ROD) were assigned onto predetermined positions in the planar white light image (Figure 1B). Each ROD had a size of 6 × 6 mm, corresponding to 30 × 30 pixels in the concatenated mouse photograph, i.e., three times larger than the Tipp-Ex® spots' dimensions in order to obey the Nyquist-Shannon sampling theorem [22] while avoiding parasite signals from the mouse body. The first step consisted in the automatic detection of the x and y coordinates of the FM based on the maximal intensity inside the corresponding RODs (Figure 1B). Three image preprocessing steps were then performed successively: (1) filtering with a 3 × 3 median filter that eliminated most of the noise present in the RODs, (2) high-pass thresholding of image pixel intensities at a threshold value of 90 % of the maximum intensity and (3) application of a Deriche's recursive Gaussian filter [23] in order to center the gradient intensity change in the images of the Tipp-Ex® spots. Following these three steps, the coordinates of the local maximum intensity in each ROD coincided with the center of the FM signal given by the Tipp-Ex® spots in the planar white light image and assigned positions (x
opt, y
opt) of the FM.
-
2.
Detection of the optical altitude (z) FM coordinates.
Since the optical surface image (Figure 1C) and the planar white light image are concatenated in the same orientation and the same pixel size, the (x, y) coordinates in both images correspond directly. The intensity values of the optical surface image representing the distance between the upper surface of the FM and the supporting plate were measured at position x
opt, y
opt to yield the z 0opt value of the upper surface of the FM. Altogether, the combination of the optical surface image and the planar white light image allowed assigning full 3-D coordinates (x
opt, y
opt, z 0opt) to each FM in the optical image.
-
3.
Detection of PET FM coordinates.
Four 3-D RODs of 9 mm3 (dimensions three times larger than the dimension of FM signal in PET image) were defined in the PET volume image (Figure 1E). Following completion of the same image preprocessing steps as for the detection of the optical planar coordinates, the local maximum was detected in each ROD to yield the coordinates (x
PET, y
PET, z
PET) of the FM in the PET volume image. Since the optical and PET signals from the FM do not coincide in the z dimension (i.e., the optical signal is on top of the Plexiglas cube, and the PET signal inserted inside the cube), a distance dz was added to account for translation in the z direction after the calculation of the rigid transformation matrix between the optical and PET image.
-
4.
Transformation from the mouse photograph to the PET volume.
A rigid transformation with translation and rotation was applied to co-register the optical and PET coordinates of the FM. With Po = {Po
1, Po
2, Po
3, Po
4} and Pp = {Pp
1, Pp
2, Pp
3, Pp
4} being the four FM positions in the optical and the PET volume images, respectively, the translation T and rotation R were defined as Equation 2:
The algorithm to compute the transformation R, T used the singular value decomposition (SVD) [24] approach to find the least square error criterion (Equation 3),
(3)
The point sets {Pp
i
} and {Po
i
} were imposed the same centroid for calculating rotation:
(4)
Rewriting and reducing Equation 3:
(5)
Transformation was expressed as Equation 6:
(6)
The , is the optimal transformation that maps the set {Pp
i
} to the {Po
i
}. Equation 5, also known as the orthogonal Procrustes problem [24, 25], is minimal when the last term is maximal.
The optical images, being proportionally larger than the PET image due (1) to the difference in the pixel size between the optical planar image (0.21 × 0.21 mm) and the PET image (0.47 × 0.47 mm), and (2) to the parallax induced by the camera detecting the Tipp-Ex® spots from the upper surface of the cube, a scaling factor was applied by calculating the average distance of the points in the x and y axes between the two modalities as (do
x
, do
y
) and (dp
x
, dp
y
):
(7)
A 2 × 2 scaling matrix was then built:
(8)
where , and S z = 1 (i.e., no scaling in the z direction).
After correcting for distance dz, the final transformation matrix T
photo-PET
for the optical photograph to the PET volume was:
(9)
where RS are the rotation matrix elements R multiplied by the scaling matrix elements S of Equation 8.
Applying the matrix in Equation 9 to the optical photography (Figure 1F) aligned the 3-D PET image (Figure 1G) to yield the co-registered bimodal image shown in Figure 1H.
The barycenter-based method
The barycenter-based method [13–18] calculates average location of body's mass weighted in space. The barycenter was calculated as the center of mass B of a system (i.e., all voxels within the RODs) defined as the average of their positions ri, weighted by their mass mi:
For the mouse photograph, as the barycenter was calculated in two dimensions, the left upper corner of each ROD was taken as origin, and the vector r
i
corresponded to the relative position from this origin to each pixel within the ROD. The signal intensity of each pixel inside the ROD gave the value of m
i
. For the PET image, the barycenter was calculated in 3-D, and the position of the first voxel (left upper in coronal view and first section in the z direction) of the 3-D ROD was taken as the origin. The position of each voxel relative to this point was taken as r
i
and the value of each voxel as m
i
. The barycenter calculated for each ROD represented the FM's position.