DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom

Abstract

Purpose The advent of three‐dimensional breast imaging systems such as digital breast tomosynthesis (DBT) has great promise for improving the detection and diagnosis of breast cancer. With these new technologies comes an essential need for testing methods to assess the resultant image quality. Although randomized clinical trials are the gold standard for assessing image quality, phantom‐based studies can provide a simpler and less burdensome approach. In this work, a complete framework is presented for task‐based evaluation of microcalcification (MCs) detection performance for DBT imaging systems. Methods The framework consists of three parts. The first part is a realistic anthropomorphic physical breast phantom created through inkjet printing, with parchment paper and iodine‐doped ink. The second is a method for inserting realistic MCs fabricated from calcium hydroxyapatite. The reproducibility and stability of the phantom materials were investigated through multiple samples of parchment and ink over 6 months. The final part is an analysis using a four‐alternative forced choice (4AFC) reader study. To demonstrate the framework, a task‐based 4AFC study was conducted using a clinical system to compare performance from DBT, synthetic mammography (SM), and full‐field digital mammography (FFDM). Nine human observers read images containing MC clusters imaged with all three modalities andmore » tried to correctly locate the MCs. The proportion correct (PC) was measured as the number of correctly detected clusters out of all trials. Results Overall, readers scored the highest with FFDM, (PC = 0.95 ± 0.03) then DBT (0.85 ± 0.04), and finally SM (0.44 ± 0.06). For the parchment and ink samples, the linear attenuation properties were very stable over 6 months. In addition, little difference was found between the various parchment and ink samples, indicating good reproducibility. Conclusions This framework presents a promising methodology for evaluating diagnostic task performance of clinical breast DBT systems.« less

Authors:
 [1];  [1];  [1];  [1];  [1];  [2];  [1]
  1. US Food and Drug Administration 10903 New Hampshire Ave Silver Spring MD 20993 USA
  2. Medical Physics Graduate Program Duke University 2424 Erwin Road Durham NC 27705 USA
Publication Date:
Sponsoring Org.:
USDOE
OSTI Identifier:
1531187
Resource Type:
Publisher's Accepted Manuscript
Journal Name:
Medical Physics
Additional Journal Information:
Journal Name: Medical Physics Journal Volume: 46 Journal Issue: 9; Journal ID: ISSN 0094-2405
Publisher:
Wiley Blackwell (John Wiley & Sons)
Country of Publication:
United States
Language:
English

Citation Formats

Ikejimba, Lynda C., Salad, Jesse, Graff, Christian G., Ghammraoui, Bahaa, Cheng, Wei‐Chung, Lo, Joseph Y., and Glick, Stephen J.. A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom. United States: N. p., 2019. Web. doi:10.1002/mp.13629.
Ikejimba, Lynda C., Salad, Jesse, Graff, Christian G., Ghammraoui, Bahaa, Cheng, Wei‐Chung, Lo, Joseph Y., & Glick, Stephen J.. A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom. United States. https://doi.org/10.1002/mp.13629
Ikejimba, Lynda C., Salad, Jesse, Graff, Christian G., Ghammraoui, Bahaa, Cheng, Wei‐Chung, Lo, Joseph Y., and Glick, Stephen J.. Fri . "A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom". United States. https://doi.org/10.1002/mp.13629.
@article{osti_1531187,
title = {A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom},
author = {Ikejimba, Lynda C. and Salad, Jesse and Graff, Christian G. and Ghammraoui, Bahaa and Cheng, Wei‐Chung and Lo, Joseph Y. and Glick, Stephen J.},
abstractNote = {Purpose The advent of three‐dimensional breast imaging systems such as digital breast tomosynthesis (DBT) has great promise for improving the detection and diagnosis of breast cancer. With these new technologies comes an essential need for testing methods to assess the resultant image quality. Although randomized clinical trials are the gold standard for assessing image quality, phantom‐based studies can provide a simpler and less burdensome approach. In this work, a complete framework is presented for task‐based evaluation of microcalcification (MCs) detection performance for DBT imaging systems. Methods The framework consists of three parts. The first part is a realistic anthropomorphic physical breast phantom created through inkjet printing, with parchment paper and iodine‐doped ink. The second is a method for inserting realistic MCs fabricated from calcium hydroxyapatite. The reproducibility and stability of the phantom materials were investigated through multiple samples of parchment and ink over 6 months. The final part is an analysis using a four‐alternative forced choice (4AFC) reader study. To demonstrate the framework, a task‐based 4AFC study was conducted using a clinical system to compare performance from DBT, synthetic mammography (SM), and full‐field digital mammography (FFDM). Nine human observers read images containing MC clusters imaged with all three modalities and tried to correctly locate the MCs. The proportion correct (PC) was measured as the number of correctly detected clusters out of all trials. Results Overall, readers scored the highest with FFDM, (PC = 0.95 ± 0.03) then DBT (0.85 ± 0.04), and finally SM (0.44 ± 0.06). For the parchment and ink samples, the linear attenuation properties were very stable over 6 months. In addition, little difference was found between the various parchment and ink samples, indicating good reproducibility. Conclusions This framework presents a promising methodology for evaluating diagnostic task performance of clinical breast DBT systems.},
doi = {10.1002/mp.13629},
journal = {Medical Physics},
number = 9,
volume = 46,
place = {United States},
year = {2019},
month = {7}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1002/mp.13629

Citation Metrics:
Cited by: 15 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Comparison of Digital Mammography Alone and Digital Mammography Plus Tomosynthesis in a Population-based Screening Program
journal, April 2013


In silico imaging clinical trials for regulatory evaluation: initial considerations for VICTRE, a demonstration study
conference, March 2017

  • Badano, Aldo; Badal, Andreu; Glick, Stephen
  • SPIE Medical Imaging, SPIE Proceedings
  • DOI: 10.1117/12.2255746

A novel physical anthropomorphic breast phantom for 2D and 3D x-ray imaging
journal, February 2017

  • Ikejimba, Lynda C.; Graff, Christian G.; Rosenthal, Shani
  • Medical Physics, Vol. 44, Issue 2
  • DOI: 10.1002/mp.12062

Effectiveness of Digital Breast Tomosynthesis Compared With Digital Mammography: Outcomes Analysis From 3 Years of Breast Cancer Screening
journal, June 2016


Development of a physical 3D anthropomorphic breast phantom: Development of a 3D anthropomorphic breast phantom
journal, January 2011

  • Carton, Ann-Katherine; Bakic, Predrag; Ullberg, Christer
  • Medical Physics, Vol. 38, Issue 2
  • DOI: 10.1118/1.3533896

Multi-reader ROC Studies with Split-plot Designs
journal, December 2012

  • Obuchowski, Nancy A.; Gallas, Brandon D.; Hillis, Stephen L.
  • Academic Radiology, Vol. 19, Issue 12
  • DOI: 10.1016/j.acra.2012.09.012

Design and application of a structured phantom for detection performance comparison between breast tomosynthesis and digital mammography
journal, January 2017

  • Cockmartin, L.; Marshall, N. W.; Zhang, G.
  • Physics in Medicine and Biology, Vol. 62, Issue 3
  • DOI: 10.1088/1361-6560/aa5407

Energy weighting improves dose efficiency in clinical practice: implementation on a spectral photon-counting mammography system
journal, August 2014

  • Berglund, Johan; Johansson, Henrik; Lundqvist, Mats
  • Journal of Medical Imaging, Vol. 1, Issue 3
  • DOI: 10.1117/1.JMI.1.3.031003

The randomized trials of breast cancer screening: what have we learned?
journal, September 2004

  • Smith, Robert A.; Duffy, Stephen W.; Gabe, Rhian
  • Radiologic Clinics of North America, Vol. 42, Issue 5
  • DOI: 10.1016/j.rcl.2004.06.014

A new, open-source, multi-modality digital breast phantom
conference, March 2016


Digital Breast Tomosynthesis From Concept to Clinical Care
journal, February 2014


TU-CD-207-08: Intrinsic Image Quality Comparison of Synthesized 2-D and FFDM Images
journal, June 2015

  • Nelson, J.; Wells, J.; Samei, E.
  • Medical Physics, Vol. 42, Issue 6Part33
  • DOI: 10.1118/1.4925627

Assessing task performance in FFDM, DBT, and synthetic mammography using uniform and anthropomorphic physical phantoms: Assessing FFDM, DBT, and SM using two phantoms
journal, September 2016

  • Ikejimba, Lynda C.; Glick, Stephen J.; Choudhury, Kingshuk Roy
  • Medical Physics, Vol. 43, Issue 10
  • DOI: 10.1118/1.4962475

Radiopaque Three-dimensional Printing: A Method to Create Realistic CT Phantoms
journal, February 2017


Comparison of the x-ray attenuation properties of breast calcifications, aluminium, hydroxyapatite and calcium oxalate
journal, March 2013


Breast cancer statistics, 2015: Convergence of incidence rates between black and white women: Breast Cancer Statistics, 2015
journal, October 2015

  • DeSantis, Carol E.; Fedewa, Stacey A.; Goding Sauer, Ann
  • CA: A Cancer Journal for Clinicians, Vol. 66, Issue 1
  • DOI: 10.3322/caac.21320

Development and validation of a modelling framework for simulating 2D-mammography and breast tomosynthesis images
journal, July 2014

  • Elangovan, Premkumar; Warren, Lucy M.; Mackenzie, Alistair
  • Physics in Medicine and Biology, Vol. 59, Issue 15
  • DOI: 10.1088/0031-9155/59/15/4275