DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom

Journal Article · · Medical Physics
DOI: https://doi.org/10.1002/mp.13629 · OSTI ID:1531187
 [1];  [1];  [1];  [1];  [1];  [2];  [1]
  1. US Food and Drug Administration 10903 New Hampshire Ave Silver Spring MD 20993 USA
  2. Medical Physics Graduate Program Duke University 2424 Erwin Road Durham NC 27705 USA

Purpose The advent of three‐dimensional breast imaging systems such as digital breast tomosynthesis (DBT) has great promise for improving the detection and diagnosis of breast cancer. With these new technologies comes an essential need for testing methods to assess the resultant image quality. Although randomized clinical trials are the gold standard for assessing image quality, phantom‐based studies can provide a simpler and less burdensome approach. In this work, a complete framework is presented for task‐based evaluation of microcalcification (MCs) detection performance for DBT imaging systems. Methods The framework consists of three parts. The first part is a realistic anthropomorphic physical breast phantom created through inkjet printing, with parchment paper and iodine‐doped ink. The second is a method for inserting realistic MCs fabricated from calcium hydroxyapatite. The reproducibility and stability of the phantom materials were investigated through multiple samples of parchment and ink over 6 months. The final part is an analysis using a four‐alternative forced choice (4AFC) reader study. To demonstrate the framework, a task‐based 4AFC study was conducted using a clinical system to compare performance from DBT, synthetic mammography (SM), and full‐field digital mammography (FFDM). Nine human observers read images containing MC clusters imaged with all three modalities and tried to correctly locate the MCs. The proportion correct (PC) was measured as the number of correctly detected clusters out of all trials. Results Overall, readers scored the highest with FFDM, (PC = 0.95 ± 0.03) then DBT (0.85 ± 0.04), and finally SM (0.44 ± 0.06). For the parchment and ink samples, the linear attenuation properties were very stable over 6 months. In addition, little difference was found between the various parchment and ink samples, indicating good reproducibility. Conclusions This framework presents a promising methodology for evaluating diagnostic task performance of clinical breast DBT systems.

Sponsoring Organization:
USDOE
OSTI ID:
1531187
Journal Information:
Medical Physics, Journal Name: Medical Physics Vol. 46 Journal Issue: 9; ISSN 0094-2405
Publisher:
Wiley Blackwell (John Wiley & Sons)Copyright Statement
Country of Publication:
United States
Language:
English

References (21)

Comparison of Digital Mammography Alone and Digital Mammography Plus Tomosynthesis in a Population-based Screening Program journal April 2013
In silico imaging clinical trials for regulatory evaluation: initial considerations for VICTRE, a demonstration study conference March 2017
Evaluation of human observer performance on lesion detectability in single‐slice and multislice dedicated breast cone beam CT images with breast anatomical background journal October 2018
A novel physical anthropomorphic breast phantom for 2D and 3D x-ray imaging journal February 2017
Effectiveness of Digital Breast Tomosynthesis Compared With Digital Mammography: Outcomes Analysis From 3 Years of Breast Cancer Screening journal June 2016
Development of a physical 3D anthropomorphic breast phantom: Development of a 3D anthropomorphic breast phantom journal January 2011
Multi-reader ROC Studies with Split-plot Designs journal December 2012
Design and application of a structured phantom for detection performance comparison between breast tomosynthesis and digital mammography journal January 2017
Evaluating the sensitivity of the optimization of acquisition geometry to the choice of reconstruction algorithm in digital breast tomosynthesis through a simulation study journal January 2015
Energy weighting improves dose efficiency in clinical practice: implementation on a spectral photon-counting mammography system journal August 2014
The randomized trials of breast cancer screening: what have we learned? journal September 2004
Digital Breast Tomosynthesis: Observer Performance of Clustered Microcalcification Detection on Breast Phantom Images Acquired with an Experimental System Using Variable Scan Angles, Angular Increments, and Number of Projection Views journal December 2014
A new, open-source, multi-modality digital breast phantom conference March 2016
Digital Breast Tomosynthesis From Concept to Clinical Care journal February 2014
Visibility of microcalcification clusters and masses in breast tomosynthesis image volumes and digital mammography: A 4AFC human observer study: Visibility of microcalcifications and masses in breast tomosynthesis journal April 2012
TU-CD-207-08: Intrinsic Image Quality Comparison of Synthesized 2-D and FFDM Images journal June 2015
Assessing task performance in FFDM, DBT, and synthetic mammography using uniform and anthropomorphic physical phantoms: Assessing FFDM, DBT, and SM using two phantoms journal September 2016
Radiopaque Three-dimensional Printing: A Method to Create Realistic CT Phantoms journal February 2017
Comparison of the x-ray attenuation properties of breast calcifications, aluminium, hydroxyapatite and calcium oxalate journal March 2013
Breast cancer statistics, 2015: Convergence of incidence rates between black and white women: Breast Cancer Statistics, 2015 journal October 2015
Development and validation of a modelling framework for simulating 2D-mammography and breast tomosynthesis images journal July 2014