Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Assessment of task‐based performance from five clinical DBT systems using an anthropomorphic breast phantom

Journal Article · · Medical Physics
DOI:https://doi.org/10.1002/mp.14568· OSTI ID:1804834
 [1];  [1];  [1];  [2];  [2];  [3];  [3];  [1];  [4];  [1]
  1. US Food and Drug Administration 10903 New Hampshire Ave Silver Spring MD 20993 USA
  2. Michigan Medicine University of Michigan 1500 East Medical Center Drive Ann Arbor MI 48109 USA
  3. Stony Brook Medicine Stony Brook University 101 Nicolls Road Stony Brook NY 11794 USA
  4. Medical Physics Graduate Program Duke University 2424 Erwin Road Durham NC 27705 USA
Purpose

Digital breast tomosynthesis (DBT) is a limited‐angle tomographic breast imaging modality that can be used for breast cancer screening in conjunction with full‐field digital mammography (FFDM) or synthetic mammography (SM). Currently, there are five commercial DBT systems that have been approved by the U.S. FDA for breast cancer screening, all varying greatly in design and imaging protocol. Because the systems are different in technical specifications, there is a need for a quantitative approach for assessing them. In this study, the DBT systems are assessed using a novel methodology with an inkjet‐printed anthropomorphic phantom and four alternative forced choice (4AFC) study scheme.

Method

A breast phantom was fabricated using inkjet printing and parchment paper. The phantom contained 5‐mm spiculated masses fabricated with potassium iodide (KI)‐doped ink and microcalcifications (MCs) made with calcium hydroxyapatite. Images of the phantom were acquired on all five systems with DBT, FFDM, and SM modalities where available using beam settings under automatic exposure control. A 4AFC study was conducted to assess reader performance with each signal under each modality. Statistical analysis was performed on the data to determine proportion correct (PC), standard deviations, and levels of significance.

Results

For masses, overall detection was highest with DBT. The difference in PC was statistically significant between DBT and SM for most systems. A relationship was observed between increasing PC and greater gantry span. For MCs, performance was highest with DBT and FFDM compared to SM. The difference between PC of DBT and PC of SM was statistically significant for all manufacturers.

Conclusions

This methodology represents a novel approach for evaluating systems. This study is the first of its kind to use an inkjet‐printed anthropomorphic phantom with realistic signals to assess performance of clinical DBT imaging systems.

Sponsoring Organization:
USDOE
OSTI ID:
1804834
Journal Information:
Medical Physics, Journal Name: Medical Physics Journal Issue: 3 Vol. 48; ISSN 0094-2405
Publisher:
Wiley Blackwell (John Wiley & Sons)Copyright Statement
Country of Publication:
United States
Language:
English

References (46)

Evaluation of Digital Breast Tomosynthesis as Replacement of Full-Field Digital Mammography Using an In Silico Imaging Trial journal November 2018
Effectiveness of Digital Breast Tomosynthesis Compared With Digital Mammography: Outcomes Analysis From 3 Years of Breast Cancer Screening journal June 2016
A novel physical anthropomorphic breast phantom for 2D and 3D x-ray imaging journal February 2017
A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom journal July 2019
Comparison between two-dimensional synthetic mammography reconstructed from digital breast tomosynthesis and full-field digital mammography for the detection of T1 breast cancer journal December 2015
Diagnostic value of the stand-alone synthetic image in digital breast tomosynthesis examinations journal August 2017
Comparison of synthetic and digital mammography with digital breast tomosynthesis or alone for the detection and classification of microcalcifications journal June 2018
Multi-reader ROC Studies with Split-plot Designs journal December 2012
A Case for Wide-Angle Breast Tomosynthesis journal July 2015
A Framework for Random-Effects ROC Analysis: Biases with the Bootstrap and Other Variance Estimators journal July 2009
Additional factors for the estimation of mean glandular breast dose using the UK mammography dosimetry protocol journal October 2000
Automated analysis of phantom images for the evaluation of long-term reproducibility in digital mammography journal February 2007
Further factors for the estimation of mean glandular dose using the United Kingdom, European and IAEA breast dosimetry protocols journal June 2009
Estimation of mean glandular dose for breast tomosynthesis: factors for use with the UK, European and IAEA breast dosimetry protocols journal December 2010
Comparison of the x-ray attenuation properties of breast calcifications, aluminium, hydroxyapatite and calcium oxalate journal March 2013
Development and validation of a modelling framework for simulating 2D-mammography and breast tomosynthesis images journal July 2014
Digital breast tomosynthesis: studies of the effects of acquisition geometry on contrast-to-noise ratio and observer preference of low-contrast objects in breast phantom images journal September 2014
Design and application of a structured phantom for detection performance comparison between breast tomosynthesis and digital mammography journal January 2017
A new, open-source, multi-modality digital breast phantom conference March 2016
A four-alternative forced choice (4AFC) software for observer performance evaluation in radiology conference March 2016
Using non-specialist observers in 4AFC human observer studies conference March 2017
Comparison of synthetic 2D images with planar and tomosynthesis imaging of the breast using a virtual clinical trial
  • Mackenzie, Alistair; Kaur, Sukmanjit; Elangovan, Premkumar
  • Medical Imaging 2018: Image Perception, Observer Performance, and Technology Assessment https://doi.org/10.1117/12.2293070
conference March 2018
Virtual clinical trial of lesion detection in digital mammography and digital breast tomosynthesis conference March 2018
Impact of angular range of digital breast tomosynthesis on mass detection in dense breasts
  • Scaduto, David A.; Huang, Hailiang; Mertelmeier, Thomas
  • Fourteenth International Workshop on Breast Imaging, 14th International Workshop on Breast Imaging (IWBI 2018) https://doi.org/10.1117/12.2318243
conference July 2018
An observer study to assess the detection of calcification clusters using 2D mammography, digital breast tomosynthesis, and synthetic 2D imaging
  • Mackenzie, Alistair; Thomson, Emma L.; Elangovan, Premkumar
  • Medical Imaging 2019: Image Perception, Observer Performance, and Technology Assessment https://doi.org/10.1117/12.2506895
conference March 2019
Classification of breast calcifications in dual-energy FFDM using a convolutional neural network: simulation study conference March 2020
Assessment of task-based performance from five clinical DBT systems using an anthropomorphic breast phantom
  • Ikejimba, Lynda C.; Salad, Jesse; Graff, Christian
  • Fifteenth International Workshop on Breast Imaging, 15th International Workshop on Breast Imaging (IWBI2020) https://doi.org/10.1117/12.2564357
conference June 2020
Potential for lower absorbed dose in digital mammography: A JAFROC experiment using clinical hybrid images with simulated dose reduction conference March 2006
Human observer detection experiments with mammograms and power-law noise journal April 2001
Toward objective and quantitative evaluation of imaging systems using images of phantoms: Toward objective and quantitative evaluation of imaging systems journal December 2005
Optimization of the acquisition geometry in digital tomosynthesis of the breast: Acquisition geometry optimization of breast tomosynthesis journal March 2009
Task-based assessment of breast tomosynthesis: Effect of acquisition parameters and quantum noisea): Effect of acquisition geometry on tomosynthesis imaging journal March 2010
Development of a physical 3D anthropomorphic breast phantom: Development of a 3D anthropomorphic breast phantom journal January 2011
Analysis of Fourier-domain task-based detectability index in tomosynthesis and cone-beam CT in relation to human observer performance: Relating tasked-based detectability index to human observer performance journal March 2011
A computational model to generate simulated three-dimensional breast masses: A computational model to generate simulated three-dimensional breast masses journal February 2015
Assessing task performance in FFDM, DBT, and synthetic mammography using uniform and anthropomorphic physical phantoms: Assessing FFDM, DBT, and SM using two phantoms journal September 2016
Quantitative versus subjective evaluation of mammography accreditation phantom images journal February 1995
Comparison of Digital Mammography Alone and Digital Mammography Plus Tomosynthesis in a Population-based Screening Program journal April 2013
Comparison of Tomosynthesis Plus Digital Mammography and Digital Mammography Alone for Breast Cancer Screening journal December 2013
Comparison of Two-dimensional Synthesized Mammograms versus Original Digital Mammograms Alone and in Combination with Tomosynthesis Images journal June 2014
Digital Breast Tomosynthesis: Observer Performance of Clustered Microcalcification Detection on Breast Phantom Images Acquired with an Experimental System Using Variable Scan Angles, Angular Increments, and Number of Projection Views journal December 2014
Digital Breast Tomosynthesis: State of the Art journal December 2015
Microcalcifications Detected at Screening Mammography: Synthetic Mammography and Digital Breast Tomosynthesis versus Digital Mammography journal December 2018
Dose reduction and its influence on diagnostic accuracy and radiation risk in digital mammography: an observer performance study using an anthropomorphic breast phantom journal July 2007
Breast cancer statistics, 2017, racial disparity in mortality by state: Breast Cancer Statistics, 2017 journal October 2017
Individual and Combined Effects of Age, Breast Density, and Hormone Replacement Therapy Use on the Accuracy of Screening Mammography journal February 2003

Related Subjects