A computational pipeline for quantification of pulmonary infections in small animal models using serial PET-CT imaging
© Bagci et al.; licensee Springer. 2013
Received: 27 March 2013
Accepted: 6 July 2013
Published: 23 July 2013
Infectious diseases are the second leading cause of death worldwide. In order to better understand and treat them, an accurate evaluation using multi-modal imaging techniques for anatomical and functional characterizations is needed. For non-invasive imaging techniques such as computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET), there have been many engineering improvements that have significantly enhanced the resolution and contrast of the images, but there are still insufficient computational algorithms available for researchers to use when accurately quantifying imaging data from anatomical structures and functional biological processes. Since the development of such tools may potentially translate basic research into the clinic, this study focuses on the development of a quantitative and qualitative image analysis platform that provides a computational radiology perspective for pulmonary infections in small animal models. Specifically, we designed (a) a fast and robust automated and semi-automated image analysis platform and a quantification tool that can facilitate accurate diagnostic measurements of pulmonary lesions as well as volumetric measurements of anatomical structures, and incorporated (b) an image registration pipeline to our proposed framework for volumetric comparison of serial scans. This is an important investigational tool for small animal infectious disease models that can help advance researchers’ understanding of infectious diseases.
We tested the utility of our proposed methodology by using sequentially acquired CT and PET images of rabbit, ferret, and mouse models with respiratory infections of Mycobacterium tuberculosis (TB), H1N1 flu virus, and an aerosolized respiratory pathogen (necrotic TB) for a total of 92, 44, and 24 scans for the respective studies with half of the scans from CT and the other half from PET. Institutional Administrative Panel on Laboratory Animal Care approvals were obtained prior to conducting this research. First, the proposed computational framework registered PET and CT images to provide spatial correspondences between images. Second, the lungs from the CT scans were segmented using an interactive region growing (IRG) segmentation algorithm with mathematical morphology operations to avoid false positive (FP) uptake in PET images. Finally, we segmented significant radiotracer uptake from the PET images in lung regions determined from CT and computed metabolic volumes of the significant uptake. All segmentation processes were compared with expert radiologists’ delineations (ground truths). Metabolic and gross volume of lesions were automatically computed with the segmentation processes using PET and CT images, and percentage changes in those volumes over time were calculated. (Continued on next page) (Continued from previous page) Standardized uptake value (SUV) analysis from PET images was conducted as a complementary quantitative metric for disease severity assessment. Thus, severity and extent of pulmonary lesions were examined through both PET and CT images using the aforementioned quantification metrics outputted from the proposed framework.
Each animal study was evaluated within the same subject class, and all steps of the proposed methodology were evaluated separately. We quantified the accuracy of the proposed algorithm with respect to the state-of-the-art segmentation algorithms. For evaluation of the segmentation results, dice similarity coefficient (DSC) as an overlap measure and Haussdorf distance as a shape dissimilarity measure were used. Significant correlations regarding the estimated lesion volumes were obtained both in CT and PET images with respect to the ground truths (R2=0.8922,p<0.01 and R2=0.8664,p<0.01, respectively). The segmentation accuracy (DSC (%)) was 93.4±4.5% for normal lung CT scans and 86.0±7.1% for pathological lung CT scans. Experiments showed excellent agreements (all above 85%) with expert evaluations for both structural and functional imaging modalities. Apart from quantitative analysis of each animal, we also qualitatively showed how metabolic volumes were changing over time by examining serial PET/CT scans. Evaluation of the registration processes was based on precisely defined anatomical landmark points by expert clinicians. An average of 2.66, 3.93, and 2.52 mm errors was found in rabbit, ferret, and mouse data (all within the resolution limits), respectively. Quantitative results obtained from the proposed methodology were visually related to the progress and severity of the pulmonary infections as verified by the participating radiologists. Moreover, we demonstrated that lesions due to the infections were metabolically active and appeared multi-focal in nature, and we observed similar patterns in the CT images as well. Consolidation and ground glass opacity were the main abnormal imaging patterns and consistently appeared in all CT images. We also found that the gross and metabolic lesion volume percentage follow the same trend as the SUV-based evaluation in the longitudinal analysis.
We explored the feasibility of using PET and CT imaging modalities in three distinct small animal models for two diverse pulmonary infections. We concluded from the clinical findings, derived from the proposed computational pipeline, that PET-CT imaging is an invaluable hybrid modality for tracking pulmonary infections longitudinally in small animals and has great potential to become routinely used in clinics. Our proposed methodology showed that automated computed-aided lesion detection and quantification of pulmonary infections in small animal models are efficient and accurate as compared to the clinical standard of manual and semi-automated approaches. Automated analysis of images in pre-clinical applications can increase the efficiency and quality of pre-clinical findings that ultimately inform downstream experimental design in human clinical studies; this innovation will allow researchers and clinicians to more effectively allocate study resources with respect to research demands without compromising accuracy.
KeywordsQuantitative analysis Pulmonary infections Small animal models PET-CT Image segmentation H1N1 Tuberculosis
There has been significant progress in the use of non-invasive imaging technologies in human (clinical) and animal (pre-clinical) research, using positron emission tomography (PET), computed tomography (CT), and magnetic resonance imaging (MRI). In addition to being used in the clinical environment on human patients, such as for diagnosing and tracking disease, CT and MRI have been used extensively in small animal research for visualization of normal and abnormal anatomical structures. On the other hand, PET imaging provides functional imaging of the biologic processes being studied, such as for the measurement of the inflammatory response in the lungs to an infectious disease or for quantifying the severity of a cancerous tumor via the radio-labeled glucose analog, 18F-fluorodeoxyglucose (FDG) [1, 2]. Recently, the use of PET along with CT and MR imaging has been an active research area for small animal studies as well as for human studies, but automated computer-assisted tools for image analysis in small animal models are still scarce due to limited resolution, similar visual appearances between normal and abnormal adjacent tissues, and heterogeneous imaging parameters such as animal positioning, radiotracer dose, and respiratory motion. In particular, automated quantification of functional imaging data in small animal models has been very limited.
Much of the small animal model literature has relied on manual or semi-automated methods for image analysis with qualitative and/or semi-quantitative measurements [3–10]. In these (mostly manual) approaches, investigators need to visually select and then manually draw regions of interest in the images from which they extract quantifiable information. For instance, it was shown in  that brain tumors were precisely delineated by using a new triple imaging modality called MRI photoacoustic-Raman nanoparticle, which helped to identify brain tumor margins. This non-invasive process allowed surgeons to remove brain tumors from mice with great accuracy. In , lung cancers were studied in mice models, and their subsequent responses to therapy in situ were examined using MRI. The authors presented quantitative and analytical methods to better visualize, understand, and quantify primary and metastatic lung tumors’ severity and progression. In another study, , genetically engineered mouse models with non-small-cell lung cancer were used to question the molecular complexity of mixed therapeutic response. In , the total lung activity of mice with chemically induced lung squamous cell carcinoma was used to measure tumor metabolic activity in lesions using longitudinal PET scans. All of these approaches are highly time-consuming, and thus, reduce the efficiency of the research, in addition to lowering reproducibility and findings.
Robust, accurate, and fast analytical tools for imaging are especially needed for infectious disease research because infected lesions often have a rapid progression over days or weeks with heterogeneous structure (size, shapes, and locations), in addition to being anatomically multi-focal, with asynchronous changes over time. Most of the small animal studies using non-invasive imaging techniques in the literature, including the ones highlighted above, are extensively focused on cancer for measuring neoplasms.
Despite unique clinical challenges in quantification and interpretation of infectious lung diseases, researchers need to develop small animal models of infectious diseases in order to study immunopathogenesis, enhance clinical diagnostic accuracy, and test possible treatment strategies [1, 11, 12]. Like cancer, research focusing on infectious disease models may benefit from current functional and structural non-invasive imaging techniques, too. For example, by using a PET-CT imaging technique, one can non-invasively visualize the quality and quantity of inflammatory cell migration and aggregation, as well as kinetics over time while also obtaining immediate information about disease burden without requiring sacrifices. Primarily, longitudinal imaging studies are invaluable for analysis of infectious disease models and tracking rapid changes in immune response.
In the presented study, we first showed the feasibility of using PET-CT imaging to track pulmonary infections in small animal images. Then, we examined the relationship between the severity and extent of pulmonary infections as assessed by PET-CT imaging longitudinally. For this purpose, we created a novel computational pipeline for reliable and accurate quantification of small animal models with respiratory infections. Our study used an automated method for measuring areas of abnormal uptake on PET images and an interactive method for analyzing corresponding anatomical structures on CT images. In addition, we longitudinally assessed lesion volumes qualitatively and quantitatively in order to increase the efficiency and quality of molecular imaging studies. This proposed methodology aims to transform imaging data into a common platform so that clinicians can quantify, diagnose, and characterize disease progression readily.
Fundamentals of PET-CT imaging
To obtain metabolic/functional information of tissues through PET scans, molecular imaging probes, such as 18F-FDG and NaF, are used to interrogate specific targets such as cell surface receptors, enzymes, and structural proteins . Given the low resolution in PET , the superior anatomic localization of a lesion is achieved by fusing the PET images to CT images such that the lesions identified on PET are then anatomically localized by analyzing the corresponding cross-sectional CT slices. To obtain anatomical and physiological information from tissues and organs, CT is usually used in small animal studies since it is the gold standard for clinical practice, particularly for lung studies [3, 4]. This dual-imaging modality approach provides a better understanding of the underlying disease by fusing both modalities into a single view.
What to measure in CT
Structural imaging methodologies (i.e., CT and MRI) provide detailed knowledge of anatomical structures such as their shape, numbers, dimensions, surfaces, geometric arrangements, locations, and relative positioning. Among these morphological measurements, the total lung volume and the fraction of lungs occupied by disease are common measurements used by clinicians and researchers to evaluate respiratory pathology. Abnormal CT imaging patterns (volume occupied by gas, tissue, and total number of alveoli) are also conventional measures frequently used by clinicians to evaluate disease state, severity, and progression of respiratory disorders, however, accurate, robust, and fast computation of these volumetric measurements require computer-aided lesion detection, image segmentation, and automatic quantification methods. Due to significant limitations in imaging (i.e., low specificity and similar appearances between normal and abnormal tissue), manual processing and computing the aforementioned metrics are still too time-consuming and difficult.
What to measure in PET
PET imaging, as a functional imaging methodology, provides a way for making in vivo measurements of specific biochemical reactions . Conventionally, the standardized uptake value (SUV), a quantitative measure of tissue activity, is widely used in assessing PET images. SUV can be used either voxel-wise or over a region/volume, and particularly in the latter case, precise identification of the region of interest (delineation) plays a vital role in diagnostic decision systems. In addition, similar to the morphological metrics used in structural imaging methodologies, volume and area of activity regions, as well as its SUV-related indexes, are used to evaluate disease extent, characterization, and severity. In other words, the precise volume/surface information of uptake regions is needed due to two reasons: (a) total volume/surface occupied by radiotracer activity can be used independently to compare the fraction of the lung affected by the infection to the fraction of the abnormal anatomical structure having activity, because only a small percentage of the abnormal tissues (i.e., consolidation) may have high metabolic activity, depending on the disease pathology, and (b) the accurate computation of SUV-related evaluation metrics requires precise delineation of uptake regions from PET scans. Even small errors in delineation can distort SUV calculations by changing the margin of the uptake regions , and this can eventually affect the characterization of the disease, evaluation of response to therapy, and the therapy planning.
Structural and functional imaging patterns pertaining to pulmonary infections
The Administrative Panel on Laboratory Animal Care approvals were obtained from each participating institute prior to conducting this research. Internationally recognized standard guidelines were followed as complied with laboratory animal care approvals.
Imaging parameters for ferret, rabbit, and mouse studies (CT scan)
Current (μ A),
size (mm 3)
NeuroLogica CereTom (CT)
0.29 × 0.29 × 0.63
512 × 512
0.20 × 0.20 × 0.20
384 × 384
Mediso Bioscan Inc (CT)
0.20 × 0.20 × 0.20
Imaging parameters for ferret, rabbit, and mouse studies (PET scan)
Size (mm 3)
Philips Mosaic HP (PET)
1.0 × 1.0 × 1.0
1.2 mCi 18F-FDG
0.78 × 0.78 × 0.80
128 × 128
2 mCi 18F-FDG
Philips Mosaic HP (PET)
0.20 × 0.20 × 0.20
0.2 mCi 18F-FDG
For the ferret study, following baseline scans pre-infection, 12 ferrets (Mustela putorius furo) were inoculated intra-nasally with a respiratory pathogen (the H1N1 influenza virus) and then subsequently imaged on days 1, 2, 3, and 6 post-infection or until euthanized for histopathology analyses. The ferrets were injected intra-peritoneally with 2 mCi of 18F-FDG and imaged 60 to 90 min post-injection. All PET and CT imaging were performed with respiratory gating on a Siemens Inveon Trimodal scanner (Siemens AG, Munich, Germany) (Tables 1 and 2). A total of 44 images (22 PET and 22 CT scans) were used for the ferret study. Although respiratory gating was used in the ferret images, ungated CT could also be used. As reported in , the effects of inspiration and expiration can be ignored in small animal CT scans of ferrets due to similar quality of ungated and gated CT scans.
For the mouse study, after baseline scans, three mice were infected with an aerosolized respiratory pathogen (necrotic TB) in a Glas-Col inhalation exposure chamber (Glas-Col, Terre Haute, IN, USA) and subsequently imaged on weeks 6, 10, and 14 post-infection or until euthanized for histopathology analysis. Mice were injected with approximately 0.200 mCi of 18F-FDG, via tail vein, and then imaged 45 min post-injection. PET images were collected using a Philips Mosaic HP scanner, and CT images were acquired using a Bioscan Inc Mediso SPECT/CT scanner (Bioscan Inc, Paris, France) (Tables 1 and 2). All images were acquired without respiratory gating. Although respiratory gating may improve image quality with less noise and motion artifacts, due to well-known effects of breathing cycle on CT imaging of mice, repeated in vivo-gated CT scans are recommended only not more frequently than weekly intervals . However, our model was not optimized for that convention (i.e., having 4-week intervals between scans), therefore, the free-breathing mode was selected as complied with the standard imaging techniques for similar conditions in other studies. A total of 24 images (12 PET and 12 CT scans) were used for the mouse study. Details of each small animal species’ CT and PET imaging parameters, as well as scanner and reconstructed image properties, can be found in Tables 1 and 2.
Small animals were imaged in different scanners, at different institutions, with varying scanner parameters (i.e., respiratory gating, slice thickness, resolution, etc.), therefore, our study constituted a good set of images for verifying the ‘robustness’ of the proposed computational platform, in terms of handling varying conditions, as well as different animal sizes and anatomies.
Proposed computational framework
The proposed computational framework for longitudinal and quantitative analysis of lung abnormalities is illustrated in Figure 2. The following are the steps involved in the computational framework for longitudinal and quantitative analysis:
Step 1. PET and CT images were acquired from the scanner.
Step 2. PET and CT images were aligned into a common anatomical reference space in order to provide one-to-one voxel correspondences between anatomical and functional images (if the images were not from the same scanner). See Additional file 1 for technical details.
Step 3. The lungs were segmented from CT scans using the proposed interactive region growing (IRG) image segmentation method. Since measurements within the lung volumes play a significant role in identifying the nature of lung disorders, it is desirable to constrain the analysis of PET uptake regions.
Step 4. Mathematical morphology (smoothing by the erosion, prior to the space multiplication of two images) was conducted between the segmented lung volumes from CT scans and corresponding PET images in order to avoid FP uptake from nearby structures of the lungs. This may occasionally appear in the border of the lungs due to the resolution difference of PET and CT as well as the interpolation operator. Resultant PET images, therefore, only show radiotracer uptake regions within the lung.
Ground truth construction
To test the accuracy and efficiency of our proposed IRG and adaptive thresholding segmentation methods, we used a widely accepted evaluation criterion of DSC [16, 22, 23] and Haussdorf distance (HD) . DSC is a measurement of spatial overlap (in percentage) between segmented object and ground truth, and HD is a shape dissimilarity metric measuring the most mismatched boundary points between the segmented object and ground truth delineation. While higher DSC and lower HD values indicate a highly accurate segmentation, one may need to also consider inter- and intra-observer agreement rates because it is often expected that the proposed method should be comparable to one of those agreement rates to determine if the method is accurate and robust. For further information on these evaluation metrics and their computations, see Additional file 1.
Co-registration of PET-CT scans
When fusing the complementary information obtained from different imaging modalities, there is a need for image registration to integrate anatomical context with functional image information . This is particularly important in studies where PET and CT images are acquired from separate scanners or when PET and CT are done at different times, both with possible interval changes in animal positioning. In our work, image registration is treated as an optimization problem, which uses normalized mutual information as a similarity metric to align different image modalities of the same subject . See Additional file 1 for further technical information on image registration used in this study.
Interactive image segmentation of lung volumes from CT scans
Region growing (RG) is one of the simplest, yet most effective, image segmentation approaches for segmenting lung regions within CT scans [23, 26]. Segmentation via RG methods is generally favored particularly in noisy images where borders are extremely difficult to detect. Although RG has been successful with the segmentation of the normal lungs in both human and small animal studies, pathological lung tissue caused by pulmonary infections can make automatic lung segmentation from CT scans very challenging. In practice, the boundaries between dense abnormal regions such as consolidations and other organs are not well defined, therefore, we used IRG segmentation, where minimal user interaction was required for the segmentation of dense abnormal regions that can cause conventional RG segmentation method to fail. The proposed algorithm starts merging unallocated neighboring voxels, based on the refined region homogeneity criteria, which is set prior to the segmentation procedure. This procedure continues iteratively until all voxels are assigned with class labels (object or background). Region homogeneity is simply set as the difference between a voxel’s intensity value and the region’s mean.
As a result of our research, we defined two alternative versions of RG segmentation so that users can select the slice-by-slice segmentation in 2D or direct segmentation in 3D, and resultant 3D segmentation can be refined by minimal user interactions. When necessary, a user can reallocate a few seeds to include some pathological parts into the segmented lung regions. This latter step is conducted in 2D, and refined segmentation is immediately included in the final outcome.
Additional file 2: Movie 1. Segmentation and quantification of lungs from CT. Please click the link below (using google account may avoid possible browser problems): https://docs.google.com/file/d/0B2XUKmP9htKTNDM5ZmtOY2Q2SUk/edit?usp=sharing. (MP4 13 MB)
Segmentation of radiotracer activities from PET scans
Segmenting functional regions from PET scans is mandatory in the quantitative evaluation of functional images. It does not only give information about volumetry of functional uptake, but it also provides correct margins for the precise computation of SUV parameters [23, 24]. We recently proposed a graph-theoretic segmentation method for radiotracer uptake regions, with ‘non-diffusive appearances’ from PET images, which achieved higher sensitivity and specificity compared to the state-of-the-art methods [16, 24]. However, since abnormalities within the lungs of a small animal infectious disease model show ‘diffusive (multi-focal) appearances’ with non-convex geometrical shapes, it may cause graph-based segmentation algorithms to leak into non-object territories within the scene. Therefore, we designed an adaptive thresholding method, suited well specifically for small animal models of pulmonary infections, in addition to the use of our previously proposed graph-based segmentation method (named random walk image segmentation of PET images [28, 29]).
Additional file 3: Movie 2. Segmentation and quantification of PET images. Please click the link below (using google account may avoid possible browser problems): https://docs.google.com/file/d/0B2XUKmP9htKTQ2xoM01JWDZSUUU/edit?usp=sharing. (MP4 14 MB)
Incorporating image registration pipeline for volume change analysis from serial scans
Quantitative measurements of change in radiotracer uptake’s spatial position require serial registration of a longitudinal image sequence from the same subject into a common space. Jointly aligning all image sequences - different scans from the same subject - to a common space allows researchers to visualize how radiotracer uptake are changing over time. This information is critical when identifying disease-related changes, particularly when exploring the severity and extent of the diseases. After aligning them into a common space, segmented structures from the same subject can be compared both locally and globally. However, direct pairwise registration of segmented PET images is not feasible because of limited anatomical markers within the images. Several image registration algorithms have been developed to achieve this goal [24, 30–34]. Among them, we used locally affine and globally smooth image registration of serial CT images [24, 33] and transfer the resulting deformation fields to the corresponding PET images because the registration method reported in [24, 33] has been shown to be much more accurate than simple affine and rigid registrations. With this procedure, one can bring PET images within a common anatomical space (CT).
To assess the efficacy and utility of our segmentation methods (in CT and PET images) quantitatively, we used accuracy measurements which are related to how well segmentation results compare with the true delineation of objects. Ground truths of delineation for the objects were obtained by expert radiologists’ annotations. We also considered efficiency measurements for the segmentation evaluation, where efficiency pertains to the practical viability of the method which is determined by the amount of time required for the computations to provide the user the help needed during segmentation.
Observer agreement study - evaluation on CT scans
Evaluation of inter/intra-observer agreements over CT and PET image segmentations is shown
Evaluation of PET
for CT volume
for PET volume
levels (difference by 5%)
Intra (%) 92.3±14.4
DSC (%) 86.0±3.6
Inter (%) 80.6±9.5
Inter (%) 89.8±14.7
HD (mm) 13.2±2.3
HD (mm) 14.2±2.1
Inter (%) 77.2±11.2
Inter (%) 81.5±16.2
HD (mm) 10.6±1.6
HD (mm) 4.0±1.4
Intra (%) 94.7±1.3
Intra (%) 86.6±2.4
Inter (%) 89.5±3.7
Inter (%) 83.2±3.6
HD (mm) 10.8±1.8
HD (mm) 0.26±0.48
Observer agreement study - evaluation on PET scans
Evaluation of the interactive segmentation method on CT scans
Evaluation of the adaptive thresholding method on PET scans
We evaluated the utility of our adaptive thresholding method for functional volumes in the small animal model by comparing the areas delineated by different threshold levels. Our observations show that clinical convention is usually suited for the segmentation experiments of PET scans for non-infected small animals, which is to set 40% of the overall histogram as a threshold value. This situation might change when infection exists: 60% to 65% of the overall histogram was usually set as a threshold value in later weeks. Moreover, we also observed that expert observers agreed within 5% of this threshold value. Therefore, starting at 20% of the PET S image histogram and ending at 90% as threshold values, we computed the DSC and HD between threshold levels varying by 5% of the image’s histogram (i.e., 20% and 25%, 25% and 30%, etc.) and then averaged DSC and HD values over different threshold values and different subjects. The DSC and HD for rabbit, ferret, and mouse are reported in Table 3. Similar to the evaluation of segmentation results from CT images in the previous subsection, we averaged the rates obtained from ground truths in order to avoid any bias towards a particular observer’s evaluation as complied with the standard evaluation techniques [19, 20]. Furthermore, Pearson correlation between estimated metabolic volume of lesions by the proposed method and the ground truth was found to be R2=0.8664,p<0.01.
Evaluation of image registration
Statistics of landmarks error (in mm) using deformable group-wise registration of segmented CT images
Computational cost, parameter training, and efficiency
All programs used in this study were developed using C++ gcc 4.5 (copyright 2010 Free Software Foundation) on a Linux platform (Ubuntu, Canonical USA Inc., Lexington, MA, USA), and all statistical computations and user interface to access segmentation, registration, and quantification algorithms were processed in Matlab (copyright 2010 MathWorks Inc., Natick, MA, USA). All the programs were executed on an Intel Ⓡ Core(TM) i7 CPU 930 at 2.80 GHz with 12 GB RAM workstation. While manual segmentation of the lung regions from CT scans takes around 60 to 90 min depending on the severity of the disease, the interactive lung segmentation takes only 16.52 s on average for approximately 250 slices. This timing can take up to 10 min for very severe cases, where a refinement step with interactive one-click process for some slices is necessary. On the other hand, segmentation of PET images takes only 11 s on average for approximately 250 slices.
Users deem it necessary to incorporate some pre-processing steps prior to actual segmentation of CT images or SUV analysis of PET images. Our proposed computational framework offers this flexibility of pre-processing images prior to conducting image analysis, as exemplified partially in the Additional files 1 and 2 demo videos. There may be other necessary steps for proper segmentation due to unconventional image features or scanner dependent variations. For instance, a scan may be loaded into the system in a prone position rather than supine, and PET correspondence of the anatomical image may be aligned in opposite direction (head to toe alignment), considering all these issues in a fully automated way requires an extensive search and individualized event detection algorithms. It may take longer for a fully automated computer algorithm to identify these problems first and take the appropriate actions due to the difficulty of ‘recognizing’ an unexpected problem. On the other hand, a human observer can easily handle these issues by visual inspection and take the necessary action within seconds. This is one of the main reasons that many research tools, including our proposed computational framework, are being developed in a way to allow users to efficiently interact with the tools .
Imaging findings and longitudinal analysis of pulmonary infections
One of the clinical research questions for this study was to investigate the immune response in the lungs to pulmonary infections over time through FDG PET-CT imaging. To demonstrate how our proposed computational pipeline would be used for longitudinal analysis of pulmonary infection, we present here an illustrative example of the TB rabbit model. For the TB rabbit model, as stated earlier, the rabbits were infected with TB and imaged longitudinally at various time points (0, 5, 10, 15, 20, 30, and 38 weeks) after initial baseline scans. Once the images are acquired, the quantification of inflammatory response can be carried out using the proposed computational framework. Since the amount of change of functional uptake volume and their strength from PET images as well as the change of pathological volume from CT images can be used as reliable markers for showing disease progression in longitudinal manner, we quantified the disease progression and resolution with these three markers. For the amount of functional uptake volume, the volume of the significant uptake regions automatically segmented from the PET images was used. For the delineated region’s signal strength, maximum SUV (i.e., SUV max) was used. Lastly, for the pathological volume marker: the volume of segmented pathologies from the CT images was used. In other words,
The SUV max was used to show how ‘intense’ the disease is
The functional uptake volume was used to demonstrate how ‘much’ immune response and inflammation was present, and
The pathological volume was used to show how much the parenchyma of the lungs had been altered due to the infection as seen on CT.
Furthermore, researchers can easily add other quantitative metrics to our proposed framework, such as SUV mean (the mean SUV over the functional uptake volume) and SUV lbm (lean body mass-based SUV), which can give an even more in-depth look at the disease progression. However, novel exploration of quantitative and semi-quantitative metrics is outside the scope of this paper.
Additional file 4: Movie 3. Visualization of FDG uptake longitudinally (rabbit 6). Please click the link below (using google account may avoid possible browser problems): https://docs.google.com/file/d/0B2XUKmP9htKTVTI4bFZ6NTJWTlk/edit?pli=1. (WMV 14 MB)
Additional file 5: Movie 4. Visualization of FDG uptake longitudinally (rabbit 7). Please click the link below (using google account may avoid possible browser problems): https://docs.google.com/file/d/0B2XUKmP9htKTcE5EMUltbUpJd0E/edit?usp=sharing. (WMV 11 MB)
Additional file 6: Movie 5. Visualization of FDG uptake longitudinally (ferret 2214). Please click the link below (using google account may avoid possible browser problems): https://docs.google.com/file/d/0B2XUKmP9htKTaUkyQzVzbDZaenc/edit?usp=sharing. (WMV 12 MB)
Our study presents a computational platform for automated and interactive methods for measuring areas of abnormal uptake on PET and corresponding anatomical structures on CT, with longitudinal assessment of lesion volumes, in order to increase the efficiency and quality of quantitative imaging studies. Although some of the methodologies presented in this manuscript such as segmentation from CT scans, PET segmentation, and co-registration aspects of the image processing tasks have been established more or less in the literature, a computational pipeline that takes into account the unique challenges of PET-CT imaging, particularly for small animal models and pulmonary infections, has not previously been explored. Considering (a) the exploration of the feasibility of PET-CT multi-modality imaging in small animals and (b) the unique challenges of pulmonary infections (i.e., multi-focal uptake in PET, diffusive abnormal imaging patterns in CT, the challenge of segmenting pathological lung regions, etc.), to the best of our knowledge, our study is the first one taking into account all these difficulties and propose a reliable, fast, and accurate computational platform to be used in pre-clinical and clinical studies.
For this study, the FDG radiotracer was used because it is the most commonly used agent for molecular imaging, but the method can also be applied to any PET tracer. In addition to the CT anatomical imaging, our proposed computational framework can also be used with MRI data fused with PET imaging, therefore, multi-modal anatomical images with functional correspondences can readily be quantified within our system. Moreover, the study presented herein focuses on small animals - rabbits, ferrets, and mice. Given the need for increasing the efficiency, speed, and quality of molecular imaging in pre-clinical research, this application of automated quantitative imaging studies for small animal models is warranted.
Our study applies to infectious disease in particular because this disease category has some unique challenges such as multi-focal heterogeneous lesions with rapid progression, necessitating more efficient methods for quantifying molecular imaging data. Given the accuracy and efficiency of our presented results, this methodology can also be applied to measuring tumor volumes in oncologic research, because diffuse PET uptake patterns and intensities caused by inflammation and infections can have very similar characteristics compared to those caused by cancer within the thoracic cavity . Indeed, the segmentation of diffuse patterns (both from CT and PET) is much more challenging compared to the segmentation of solid tumors, hence, our methods can readily be used within different frameworks concerning cancer-related problems. Our computational platform can also provide automated tumor volume measurement using the same approach as the demonstrated measurement of abnormal PET-CT findings in infection to provide serial volumetric data and longitudinal changes in SUV intensity.
In this paper, infectious disease progression was analyzed and reported for small animals, however, the ultimate aim within the scope of this research is to find and understand the progression of infectious diseases in human subjects as well. To the best of our knowledge, there is no systematic study exploring this longitudinal phenomena in human clinical trials yet. Based on our previous research [44–46] and some other works showing the imaging findings of pulmonary infections, there are certain similarities in image analysis of pre-clinical and clinical subjects. Consolidations and GGOs are the two main imaging patterns from CT images which are observed both in human subjects and small animals. Similarly, SUV analysis of lesions detected from PET images is conducted in the same way for human subjects and small animals . On the other hand, we can argue that the spectrum of the observed imaging patterns from CT images will be wider than the observed imaging patterns of small animals. For instance, in parainfluenza and H1N1 infections in human subjects [44–46], we observed not only GGO and consolidations but also tree-in-bud, nodules, pleural effusions, and interstitial thickening. Therefore, additional individual analysis of how those patterns change longitudinally (i.e., shape and volume) could bring certain additional insights into the exploration of pulmonary infection dynamics in human subjects. However, these analyses require separate CAD systems for each abnormal imaging pattern pertaining to pulmonary infections.
Future studies will aim to correlate the automated algorithm’s performance with other parameters of respiratory disease such as histopathology, inflammatory cell counts, and viral/bacterial titers. For this purpose, we are currently developing novel methods for automatic airway extraction and quantification as well as simultaneous co-segmentation and co-evaluation of CT, MRI, and PET multi-modality images [28, 47].
Experimental results showed that automated computer-detection of lesions in pulmonary infections through our proposed computational pipeline is efficient and accurate relative to the manual approaches and thereby increases reproducibility of automated quantification of disease immunopathology in small animal models. The immense importance of infectious disease imaging in small animal models is based on the fundamental necessity to study disease pathogenesis and host immune response as well as to assess therapeutic measures such as medications and vaccines, on a time scale basis on the same subject(s). Measuring disease follow-up is especially important because the evaluation of the natural progression of untreated disease as compared to the regression of treated disease requires accurate serial quantification over time.
Our proposed computational platform is novel and unique, which is suited well for analysis and quantification of pulmonary infections in pre-clinical and clinical research questions. We demonstrated our computational framework’s feasibility and robustness using longitudinal PET and CT images obtained from multiple small animals and compared its performance to expert delineations.We concluded from the clinical findings derived from the proposed computational pipeline that serial PET-CT imaging is an invaluable hybrid modality for tracking pulmonary infections in small animals and has great potential to become the state-of-the-art imaging tool in routine clinics for pulmonary infections. In a broader perspective, we hope that the methods and experiments presented here will support further exploration of infectious diseases in different small animal models.
Dice similarity coefficient
Fuzzy locally adaptive Bayesian
Interactive region growing
Iterative thresholding method
Magnetic resonance imaging
Positron emission tomography
Standardized uptake value
This study is supported by the Center for Infectious Disease Imaging (CIDI) and Intramural Research Program of the National Institutes of Health. Dr Jain acknowledges the NIH Director’s New Inventor Award (OD006492). The rabbit infection study is funded by HHMI, NIAD R01AI079590, and R01A1035272.
- Juweid ME, Cheson BD: Positron-emission tomography and assessment of cancer therapy. N Engl J Med 2006,354(5):496–507. 10.1056/NEJMra050276View ArticlePubMed
- Studwell AJ, Kotton DN: A shift from cell cultures to creatures: in vivo imaging of small animals in experimental regenerative medicine. Mol Ther 2011,19(11):1933–1941. 10.1038/mt.2011.194View ArticlePubMed
- Kircher MF, de la Zerda A, Jokerst JV, Zavaleta CL, Kempen PJ, Mittra E, Pitter K, Habte F, Sinclair R, Brennan CW, Mellinghoff IK, Holland EC, Gambhir SS, Huang R: A brain tumor molecular imaging strategy using a new triple-modality MRI-photoacoustic-Raman nanoparticle. Nat Med 2012,18(5):829–834. 10.1038/nm.2721View ArticlePubMed
- Krupnick AS, Tidwell VK, Engelbach JA, Alli VV, Nehorai A, You M, Vikis HG, Gelman AE, Kreisel D, Garbow JR: Quantitative monitoring of mouse lung tumors by magnetic resonance imaging. Nat Protoc 2012, 7: 128–142. 10.1038/nprot.2011.424View ArticlePubMed
- Chen Z, Cheng K, Walton Z, Wang Y, Ebi H, Shimamura T, Liu Y, Tupper T, Ouyang J, Li J, Gao P, Woo MS, Xu C, Yanagita M, Altabef A, Wang S, Lee C, Nakada Y, Peña CG, Sun Y, Franchetti Y, Yao C, Saur A, Cameron MD, Nishino M, Hayes DN, Wilkerson MD, Roberts PJ, Lee CB, Bardeesy N, et al.: A murine lung cancer co-clinical trial identifies genetic modifiers of therapeutic response. Nature 2012,483(7391):613–617. 10.1038/nature10937View ArticlePubMed
- Ambrosini V, Nanni C, Pettinato C, Fini M, D’Errico A, Trepidi S, Spinelli A, Al-Nahhas A, Rubello D, Zompatori M, Fabbri M, Franchi R, Fanti S: Assessment of a chemically induced model of lung squamous cell carcinoma in mice by 18F-FDG small-animal PET. Nucl Med Commun 2007,28(8):647–652. 10.1097/MNM.0b013e32823f9ffaView ArticlePubMed
- Manabe YC, Kesavan AK, Lopez-Molina J, Hatem CL, Brooks M, Fujiwara R, Hochstein K, Pitt MLM, Tufariello J, Chan J, McMurray DN, Bishai WR, Dannenberg AMJr, Mendez S: The aerosol rabbit model of TB latency, reactivation and immune reconstitution inflammatory syndrome. Tuberculosis (Edinb) 2008,88(3):187–196. 10.1016/j.tube.2007.10.006View Article
- Nahrendorf M, Keliher E, Marinelli B, Waterman P, Feruglio PF, Fexon L, Pivovarov M, Swirski FK, Pittet MJ, Vinegoni C, Weissleder R: Hybrid PET-optical imaging using targeted probes. Proc Natl Acad Sci U S A 2010,107(17):7910–7915. 10.1073/pnas.0915163107View ArticlePubMed
- Aberle DR, Berg CD, Black WC, Church TR, Fagerstrom RM, Galen B, Gareen IF, Gatsonis C, Goldin J, Gohagan JK, Hillman B, Jaffe C, Kramer BS, Lynch D, Marcus PM, Schnall M, Sullivan DC, Sullivan D, Zylak CJ, Team NLSTR: The National Lung Screening Trial: overview and study design. Radiology 2011, 258: 243–253.View ArticlePubMed
- Bagci U, Bray M, Caban J, Yao J, Mollura DJ: Computer-assisted detection of infectious lung diseases: a review. Comput Med Imaging Graph 2012, 36: 72–84. 10.1016/j.compmedimag.2011.06.002View ArticlePubMed
- Davis SL, Be NA, Lamichhane G, Nimmagadda S, Pomper MG, Bishai WR, Jain SK: Bacterial thymidine kinase as a non-invasive imaging reporter for Mycobacterium tuberculosis in live animals. PLoS One 2009,4(7):e6297. 10.1371/journal.pone.0006297View ArticlePubMed
- Harper J, Skerry C, Davis SL, Tasneen R, Weir M, Kramnik I, Bishai WR, Pomper MG, Nuermberger EL, Jain SK: Mouse model of necrotic tuberculosis granulomas develops hypoxic lesions. J Infect Dis 2012,205(4):595–602. 10.1093/infdis/jir786View ArticlePubMed
- Phelps ME, Mazziotta JC: Positron emission tomography: human brain function and biochemistry. Science 1985,228(4701):799–809. 10.1126/science.2860723View ArticlePubMed
- Wu A, Zheng H, Kraenzle J, Biller A, Vanover C, Proctor M, Sherwood L, Steffen M, Ng C, Mollura D, Jonsson C: Ferret thoracic anatomy by 2-deoxy-2-(18F)fluoro-D-glucose (18F-FDG) positron emission tomography/computed tomography (18F-FDG PET/CT) imaging. ILAR 2012, 51: E9—21.
- Cavanaugh D, Johnson E, Price R, Kurie J, Travis E, Cody D: In vivo respiratory-gated micro-CT imaging in small-animal oncology models. Mol Imaging 2004, 3: 55–62. 10.1162/153535004773861723View ArticlePubMed
- Bagci U, Chen X, Udupa JK: Hierarchical scale-based multiobject recognition of 3-D anatomical structures. IEEE Trans Med Imaging 2012,31(3):777–789.View ArticlePubMed
- Falcao AX, Udupa JK, Miyazawa FK: An ultra-fast user-steered image segmentation paradigm: live wire on the fly. IEEE Trans Med Imaging 2000, 19: 55–62. 10.1109/42.832960View ArticlePubMed
- Top A, Hamarneh G, Abugharbieh R: Active learning for interactive 3D image segmentation. Med Image Comput Comput Assist Interv 2011,14(Pt 3):603–610.PubMed
- Udupa JK, LeBlanc VR, Zhuge Y, Imielinska C, Schmidt H, Currie LM, Hirsch BE, Woodburn J: A framework for evaluating image segmentation algorithms. Comp Med Imag Graph 2006,30(2):75–87. 10.1016/j.compmedimag.2005.12.001View Article
- Warfield SK, Zou KH, Wells WM: Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans Med Imag 2004, 23: 903–921. 10.1109/TMI.2004.828354View Article
- Armstrong CJ, Price BL, Barrett WA: Interactive segmentation of image volumes with live surface. Comput Graph 2007, 31: 212–229. 10.1016/j.cag.2006.11.015View Article
- Crum WR, Camara O, Hill DLG: Generalized overlap measures for evaluation and validation in medical image analysis. IEEE Trans Med Imaging 2006,25(11):1451–1461.View ArticlePubMed
- Sonka M, Hlavac V, Boyle R: Image Processing, Analysis, and Machine Vision. Chapman and Hall Publishers; 1993.View Article
- Bagci U, Bai L: Multiresolution elastic medical image registration in standard intensity scale. In. In IEEE 20th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI-07): October 7–10 2007, Belo Horizonte-Minas Gerais. Pisacataway: IEEE; 2007:305–312.View Article
- Staring M, Klein S, Viergever MA, Pluim JPW, van der Heide UA: Registration of cervical MRI using multifeature mutual information. IEEE Trans Med Imaging 2009,28(9):1412–1421.View ArticlePubMed
- Ciesielski KC, Udupa JK, Saha PK, Zhuge Y: Iterative relative fuzzy connectedness for multiple objects with multiple seeds. Comput Vis Image Underst 2007,107(3):160–182. 10.1016/j.cviu.2006.10.005View ArticlePubMed
- Sofka M, Wetzl J, Birkbeck N, Zhang J, Kohlberger T, Kaftan J, Declerck J, Zhou S: Multi-stage learning for robust lung segmentation in challenging CT volumes. In Proceedings of the 14th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2011): 2011 September 18–22 : Toronto, Canada. Berlin, Heidelberg: Springer-Verlag; 2011.
- Bagci U, Udupa JK, Yao J, Mollura DJ: Co-segmentation of functional and anatomical images. Med Image Comput Comput Assist Interv 2012, 7512: 459–467.
- Bagci U, Yao J, Miller-Jaster K, Chen X, Mollura DJ: Predicting future morphological changes of lesions from radiotracer uptake in 18F-FDG-PET images. Plos One 2013,8(2):e57105. 10.1371/journal.pone.0057105View ArticlePubMed
- Liao S, Jia H, Wu G, Shen D, ADNI: A novel framework for longitudinal atlas construction with groupwise registration of subject image sequences. Neuroimage 2012,59(2):1275–1289.View ArticlePubMed
- Xue Z, Shen D, Davatzikos C: CLASSIC: consistent longitudinal alignment and segmentation for serial image computing. Neuroimage 2006,30(2):388–399. 10.1016/j.neuroimage.2005.09.054View ArticlePubMed
- Wu G, Wang Q, Shen D, ADNI: Registration of longitudinal brain image sequences with implicit template and spatial-temporal heuristics. Neuroimage 2012, 59: 404–421. 10.1016/j.neuroimage.2011.07.026View ArticlePubMed
- Periaswamy S, Farid H: Elastic registration in the presence of intensity variations. IEEE Trans Med Imaging 2003,22(7):865–874. 10.1109/TMI.2003.815069View ArticlePubMed
- Freeborough PA, Fox NC: The boundary shift integral: an accurate and robust measure of cerebral volume changes from registered repeat MRI. IEEE Trans Med Imaging 1997,16(5):623–629. 10.1109/42.640753View ArticlePubMed
- Ibanez L, Schroeder W, Ng L, Cates J, Insight Software Consortium: The ITK Software Guide, Volume 8. Carrboro, North Carolina, USA: Kitware; 2003.
- Drever L, Roa W, McEwan A, Robinson D: Iterative threshold segmentation for PET target volume delineation. Med Phys 2007,34(4):1253–1265. 10.1118/1.2712043View ArticlePubMed
- Otsu N: A threshold selection method from gray-level histograms. Automatica 1975,11(285–296):23–27.
- Hatt M, Turzo A, Roux C, Visvikis D, Cheze le Rest C: A fuzzy locally adaptive Bayesian segmentation approach for volume determination in PET. Med Imaging, IEEE Trans 2009,28(6):881–893.View Article
- Castillo R, Castillo E, Guerra R, Johnson VE, McPhail T, Garg AK, Guerrero T: A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets. Phys Med Biol 2009,54(7):1849. 10.1088/0031-9155/54/7/001View ArticlePubMed
- Kesner AL, Dahlbom M, Huang SC, Hsueh WA, Pio BS, Czernin J, Kreissl M, Wu HM, Silverman DH: Semiautomated analysis of small-animal PET data. J Nuclear Med 2006,47(7):1181–1186.
- Eliceiri KW, Berthold MR, Goldberg IG, Ibáñez L, Manjunath B, Martone ME, Murphy RF, Peng H, Plant AL, Roysam B, Stuurman N, Swedlow JR, Tomancak P, Carpenter AE: Biological imaging software tools. Nature Methods 2012,9(7):697–710. 10.1038/nmeth.2084View ArticlePubMed
- Kovacs T, Cattin P, Alkadhi H, Wildermuth S, Szekely G: Automatic segmentation of the vessel lumen from 3D CTA images of aortic dissection. In Bildverarbeitung fur die Medizin 2006. Berlin Heidelberg: Springer; 2006:161–165.View Article
- O’Donnell T, Gupta A, Boult T: A new model for the recovery of cylindrical structures from medical image data. In Lecture Notes in Computer Science of CVRMed-MRCAS’97 Volume 1205. Berlin Heidelberg: Springer; 1997:223–232.
- Bagci U, Yao J, Wu A, Caban J, Palmore TN, Suffredini AF, Aras O, Mollura DJ: Automatic detection and quantification of tree-in-bud (TIB) opacities from CT scans. Biomed Eng, IEEE Trans 2012,59(6):1620–1632.View Article
- Bray M, Lawler J, Paragas J, Jahrling P, Mollura D: Molecular imaging of influenza and other emerging respiratory viral infections. J Infect Dis 2011,203(10):1348–1359. 10.1093/infdis/jir038View ArticlePubMed
- Mollura D, Morens D, Taubenberger J, Bray M: The role of radiology in influenza: novel H1N1 and lessons learned from the 1918 pandemic. J Am Coll Radiol 2010,7(9):690–697. 10.1016/j.jacr.2010.01.007View ArticlePubMed
- Bagci U, Udupa JK, Mendhiratta N, Foster B, Xu Z, Yao J, Chen X, Mollura DJ: Joint segmentation of anatomical and functional images: applications in quantification of lesions from PET, PET-CT, MRI-PET, and MRI-PET-CT images. Med Image Anal 2013,17(8):929–945. 10.1016/j.media.2013.05.004View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License(http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.