skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: MO-DE-207B-07: Assessment of Reproducibility Of FDG-PET-Based Radiomics Features Across Scanners Using Phantom Imaging

Abstract

Purpose: Use a NEMA-IEC PET phantom to assess the robustness of FDG-PET-based radiomics features to changes in reconstruction parameters across different scanners. Methods: We scanned a NEMA-IEC PET phantom on 3 different scanners (GE Discovery VCT, GE Discovery 710, and Siemens mCT) using a FDG source-to-background ratio of 10:1. Images were retrospectively reconstructed using different iterations (2–3), subsets (21–24), Gaussian filter widths (2, 4, 6mm), and matrix sizes (128,192,256). The 710 and mCT used time-of-flight and point-spread-functions in reconstruction. The axial-image through the center of the 6 active spheres was used for analysis. A region-of-interest containing all spheres was able to simulate a heterogeneous lesion due to partial volume effects. Maximum voxel deviations from all retrospectively reconstructed images (18 per scanner) was compared to our standard clinical protocol. PET Images from 195 non-small cell lung cancer patients were used to compare feature variation. The ratio of a feature’s standard deviation from the patient cohort versus the phantom images was calculated to assess for feature robustness. Results: Across all images, the percentage of voxels differing by <1SUV and <2SUV ranged from 61–92% and 88–99%, respectively. Voxel-voxel similarity decreased when using higher resolution image matrices (192/256 versus 128) and was comparable acrossmore » scanners. Taking the ratio of patient and phantom feature standard deviation was able to identify features that were not robust to changes in reconstruction parameters (e.g. co-occurrence correlation). Metrics found to be reasonably robust (standard deviation ratios > 3) were observed for routinely used SUV metrics (e.g. SUVmean and SUVmax) as well as some radiomics features (e.g. co-occurrence contrast, co-occurrence energy, standard deviation, and uniformity). Similar standard deviation ratios were observed across scanners. Conclusions: Our method enabled a comparison of feature variability across scanners and was able to identify features that were not robust to changes in reconstruction parameters.« less

Authors:
 [1]; ; ; ; ; ;  [2]
  1. University of North Carolina at Chapel Hill, Chapel Hill, NC (United States)
  2. UT MD Anderson Cancer Center, Houston, TX (United States)
Publication Date:
OSTI Identifier:
22649568
Resource Type:
Journal Article
Resource Relation:
Journal Name: Medical Physics; Journal Volume: 43; Journal Issue: 6; Other Information: (c) 2016 American Association of Physicists in Medicine; Country of input: International Atomic Energy Agency (IAEA)
Country of Publication:
United States
Language:
English
Subject:
60 APPLIED LIFE SCIENCES; 61 RADIATION PROTECTION AND DOSIMETRY; BIOMEDICAL RADIOGRAPHY; IMAGES; MATRICES; PATIENTS; PHANTOMS; POSITRON COMPUTED TOMOGRAPHY; TIME-OF-FLIGHT METHOD

Citation Formats

Fried, D, Meier, J, Mawlawi, O, Zhou, S, Ibbott, G, Liao, Z, and Court, L. MO-DE-207B-07: Assessment of Reproducibility Of FDG-PET-Based Radiomics Features Across Scanners Using Phantom Imaging. United States: N. p., 2016. Web. doi:10.1118/1.4957256.
Fried, D, Meier, J, Mawlawi, O, Zhou, S, Ibbott, G, Liao, Z, & Court, L. MO-DE-207B-07: Assessment of Reproducibility Of FDG-PET-Based Radiomics Features Across Scanners Using Phantom Imaging. United States. doi:10.1118/1.4957256.
Fried, D, Meier, J, Mawlawi, O, Zhou, S, Ibbott, G, Liao, Z, and Court, L. Wed . "MO-DE-207B-07: Assessment of Reproducibility Of FDG-PET-Based Radiomics Features Across Scanners Using Phantom Imaging". United States. doi:10.1118/1.4957256.
@article{osti_22649568,
title = {MO-DE-207B-07: Assessment of Reproducibility Of FDG-PET-Based Radiomics Features Across Scanners Using Phantom Imaging},
author = {Fried, D and Meier, J and Mawlawi, O and Zhou, S and Ibbott, G and Liao, Z and Court, L},
abstractNote = {Purpose: Use a NEMA-IEC PET phantom to assess the robustness of FDG-PET-based radiomics features to changes in reconstruction parameters across different scanners. Methods: We scanned a NEMA-IEC PET phantom on 3 different scanners (GE Discovery VCT, GE Discovery 710, and Siemens mCT) using a FDG source-to-background ratio of 10:1. Images were retrospectively reconstructed using different iterations (2–3), subsets (21–24), Gaussian filter widths (2, 4, 6mm), and matrix sizes (128,192,256). The 710 and mCT used time-of-flight and point-spread-functions in reconstruction. The axial-image through the center of the 6 active spheres was used for analysis. A region-of-interest containing all spheres was able to simulate a heterogeneous lesion due to partial volume effects. Maximum voxel deviations from all retrospectively reconstructed images (18 per scanner) was compared to our standard clinical protocol. PET Images from 195 non-small cell lung cancer patients were used to compare feature variation. The ratio of a feature’s standard deviation from the patient cohort versus the phantom images was calculated to assess for feature robustness. Results: Across all images, the percentage of voxels differing by <1SUV and <2SUV ranged from 61–92% and 88–99%, respectively. Voxel-voxel similarity decreased when using higher resolution image matrices (192/256 versus 128) and was comparable across scanners. Taking the ratio of patient and phantom feature standard deviation was able to identify features that were not robust to changes in reconstruction parameters (e.g. co-occurrence correlation). Metrics found to be reasonably robust (standard deviation ratios > 3) were observed for routinely used SUV metrics (e.g. SUVmean and SUVmax) as well as some radiomics features (e.g. co-occurrence contrast, co-occurrence energy, standard deviation, and uniformity). Similar standard deviation ratios were observed across scanners. Conclusions: Our method enabled a comparison of feature variability across scanners and was able to identify features that were not robust to changes in reconstruction parameters.},
doi = {10.1118/1.4957256},
journal = {Medical Physics},
number = 6,
volume = 43,
place = {United States},
year = {Wed Jun 15 00:00:00 EDT 2016},
month = {Wed Jun 15 00:00:00 EDT 2016}
}
  • Purpose: To investigate the impact of reconstruction Field of View on Radiomics features in computed tomography (CT) using a texture phantom. Methods: A rectangular Credence Cartridge Radiomics (CCR) phantom, composed of 10 different cartridges, was scanned on four different CT scanners from two manufacturers. A pre-defined scanning protocol was adopted for consistency. The slice thickness and reconstruction interval of 1.5 mm was used on all scanners. The reconstruction FOV was varied to result a voxel size ranging from 0.38 to 0.98 mm. A spherical region of interest (ROI) was contoured on the shredded rubber cartridge from CCR phantom CT scans.more » Ninety three Radiomics features were extracted from ROI using an in-house program. These include 10 shape, 22 intensity, 26 GLCM, 11 GLZSM, 11 RLM, 5 NGTDM and 8 fractal dimensional features. To evaluate the Interscanner variability across three scanners, a coefficient of variation (COV) was calculated for each feature group. Each group was further classified according to the COV by calculating the percentage of features in each of the following categories: COV≤ 5%, between 5 and 10% and ≥ 10%. Results: Shape features were the most robust, as expected, because of the spherical contouring of ROI. Intensity features were the second most robust with 54.5 to 64% of features with COV < 5%. GLCM features ranged from 31 to 35% for the same category. RLM features were sensitive to specific scanner and 5% variability was 9 to 54%. Almost all GLZM and NGTDM features showed COV ≥10% among the scanners. The dependence of fractal dimensions features on FOV was not consistent across different scanners. Conclusion: We concluded that reconstruction FOV greatly influence Radiomics features. The GLZSM and NGTDM are highly sensitive to FOV. funded in part by Grant NIH/NCI R01CA190105-01.« less
  • Purpose: The goal of this study was to evaluate the repeatability of radiomics features (intensity, shape and heterogeneity) in both PET and low-dose CT components of test-retest FDG-PET/CT images in a prospective multicenter cohort of 74 NSCLC patients from ACRIN 6678 and a similar Merck trial. Methods: Seventy-four patients with stage III-IV NCSLC were prospectively included. The primary tumor and up to 3 additional lesions per patient were analyzed. The Fuzzy Locally Adaptive Bayesian algorithm was used to automatically delineate metabolically active volume (MAV) in PET. The 3D SlicerTM software was exploited to delineate anatomical volumes (AV) in CT. Tenmore » intensity first-order features, as well as 26 textural features and four 3D shape descriptors were calculated from tumour volumes in both modalities. The repeatability of each metric was assessed by Bland-Altman analysis. Results: One hundred and five lesions (primary tumors and nodal or distant metastases) were delineated and characterized. The MAV and AV determination had a repeatability of −1.4±11.0% and −1.2±18.7% respectively. Several shape and heterogeneity features were found to be highly or moderately repeatable (e.g., sphericity, co-occurrence entropy or intensity size-zone matrix zone percentage), whereas others were confirmed as unreliable with much higher variability (more than twice that of the corresponding volume determination). Conclusion: Our results in this large multicenter cohort with more than 100 measurements confirm the PET findings in previous studies (with <30 lesions). In addition, our study is the first to explore the repeatability of radiomics features in the low-dose CT component of PET/CT acquisitions (previous studies considered dosimetry CT, CE-CT or CBCT). Several features were identified as reliable in both PET and CT components and could be used to build prognostic models. This work has received a French government support granted to the CominLabs excellence laboratory and managed by the National Research Agency in the “Investing for the Future” program under reference ANR-10-LABX-07-01, and support from the city of Brest.« less
  • Purpose: Radiomics have shown potential for predicting treatment outcomes in several body sites. This study investigated the correlation between PET Radiomics features and treatment response of cervical cancer outcomes. Methods: our dataset consisted of a cohort of 79 patients diagnosed with cervical cancer, FIGO stage IB-IVA, age range 25–86 years, (median age at diagnosis: 50 years) all treated between: 2009–14 with external beam radiation therapy to a dose range between: 45–50.4 Gy (median= 45 Gy), concurrent cisplatin chemotherapy and MRI-based brachytherapy to a dose of 20–30 Gy (median= 28 Gy). Metabolic Tumor Volume (MTV) in patient’s primary site was delineatedmore » on pretreatment PET/CT by two board certified Radiation Oncologists. The features extracted from each patient’s volume were: 26 Co-occurrence matrix (COM) Feature, 11 Run-Length Matrix (RLM), 11 Gray Level Size Zone Matrix (GLSZM) and 33 Intensity-based features (IBF). The treatment outcome was divided based on the last follow up status into three classes: No Evidence of Disease (NED), Alive with Disease (AWD) and Dead of Disease (DOD). The ability for the radiomics features to differentiate between the 3 treatments outcome categories were assessed by One-Way ANOVA test with p-value < 0.05 was to be statistically significant. The results from the analysis were compared with the ones obtained previously for standard Uptake Value (SUV). Results: Based on patients last clinical follow-up; 52 showed NED, 17 AWD and 10 DOD. Radiomics Features were able to classify the patients based on their treatment response. A parallel analysis was done for SUV measurements for comparison. Conclusion: Radiomics features were able to differentiate between the three different classes of treatment outcomes. However, most of the features were only able to differentiate between NED and DOD class. Also, The ability or radiomics features to differentiate types of response were more significant than SUV.« less
  • Purpose: Site-specific investigations of the role of Radiomics in cancer diagnosis and therapy are needed. We report of the reproducibility of quantitative image features over different discrete voxel levels in PET/CT images of cervical cancer. Methods: Our dataset consisted of the pretreatment PET/CT scans from a cohort of 76 patients diagnosed with cervical cancer, FIGO stage IB-IVA, age range 31–76 years, treated with external beam radiation therapy to a dose range between 45–50.4 Gy (median dose: 45 Gy), concurrent cisplatin chemotherapy and MRI-based Brachytherapy to a dose of 20–30 Gy (median total dose: 28 Gy). Two board certified radiation oncologistsmore » delineated Metabolic Tumor volume (MTV) for each patient. Radiomics features were extracted based on 32, 64, 128 and 256 discretization levels (DL). The 64 level was chosen to be the reference DL. Features were calculated based on Co-occurrence (COM), Gray Level Size Zone (GLSZM) and Run-Length (RLM) matrices. Mean Percentage Differences (Δ) of features for discrete levels were determined. Normality distribution of Δ was tested using Kolomogorov - Smirnov test. Bland-Altman test was used to investigate differences between feature values measured on different DL. The mean, standard deviation and upper/lower value limits for each pair of DL were calculated. Interclass Correlation Coefficient (ICC) analysis was performed to examine the reliability of repeated measures within the context of the test re-test format. Results: 3 global and 5 regional features out of 48 features showed distribution not significantly different from a normal one. The reproducible features passed the normality test. Only 5 reproducible results were reliable, ICC range 0.7 – 0.99. Conclusion: Most of the radiomics features tested showed sensitivity to voxel level discretization between (32 – 256). Only 4 GLSZM, 3 COM and 1 RLM showed insensitivity towards mentioned discrete levels.« less
  • Purpose: The goal of this work is to investigate the use of contrast enhanced computed tomographic (CT) features for the prediction of mutations of BAP1, PBRM1, and VHL genes in renal cell carcinoma (RCC). Methods: For this study, we used two patient databases with renal cell carcinoma (RCC). The first one consisted of 33 patients from our institution (UT Southwestern Medical Center, UTSW). The second one consisted of 24 patients from the Cancer Imaging Archive (TCIA), where each patient is connected by a unique identi?er to the tissue samples from the Cancer Genome Atlas (TCGA). From the contrast enhanced CTmore » image of each patient, tumor contour was first delineated by a physician. Geometry, intensity, and texture features were extracted from the delineated tumor. Based on UTSW dataset, we completed feature selection and trained a support vector machine (SVM) classifier to predict mutations of BAP1, PBRM1 and VHL genes. We then used TCIA-TCGA dataset to validate the predictive model build upon UTSW dataset. Results: The prediction accuracy of gene expression of TCIA-TCGA patients was 0.83 (20 of 24), 0.83 (20 of 24), and 0.75 (18 of 24) for BAP1, PBRM1, and VHL respectively. For BAP1 gene, texture feature was the most prominent feature type. For PBRM1 gene, intensity feature was the most prominent. For VHL gene, geometry, intensity, and texture features were all important. Conclusion: Using our feature selection strategy and models, we achieved predictive accuracy over 0.75 for all three genes under the condition of using patient data from one institution for training and data from other institutions for testing. These results suggest that radiogenomics can be used to aid in prognosis and used as convenient surrogates for expensive and time consuming gene assay procedures.« less