A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom
Abstract
Purpose The advent of three‐dimensional breast imaging systems such as digital breast tomosynthesis (DBT) has great promise for improving the detection and diagnosis of breast cancer. With these new technologies comes an essential need for testing methods to assess the resultant image quality. Although randomized clinical trials are the gold standard for assessing image quality, phantom‐based studies can provide a simpler and less burdensome approach. In this work, a complete framework is presented for task‐based evaluation of microcalcification (MCs) detection performance for DBT imaging systems. Methods The framework consists of three parts. The first part is a realistic anthropomorphic physical breast phantom created through inkjet printing, with parchment paper and iodine‐doped ink. The second is a method for inserting realistic MCs fabricated from calcium hydroxyapatite. The reproducibility and stability of the phantom materials were investigated through multiple samples of parchment and ink over 6 months. The final part is an analysis using a four‐alternative forced choice (4AFC) reader study. To demonstrate the framework, a task‐based 4AFC study was conducted using a clinical system to compare performance from DBT, synthetic mammography (SM), and full‐field digital mammography (FFDM). Nine human observers read images containing MC clusters imaged with all three modalities andmore »
- Authors:
-
- US Food and Drug Administration 10903 New Hampshire Ave Silver Spring MD 20993 USA
- Medical Physics Graduate Program Duke University 2424 Erwin Road Durham NC 27705 USA
- Publication Date:
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1531187
- Resource Type:
- Publisher's Accepted Manuscript
- Journal Name:
- Medical Physics
- Additional Journal Information:
- Journal Name: Medical Physics Journal Volume: 46 Journal Issue: 9; Journal ID: ISSN 0094-2405
- Publisher:
- Wiley Blackwell (John Wiley & Sons)
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Ikejimba, Lynda C., Salad, Jesse, Graff, Christian G., Ghammraoui, Bahaa, Cheng, Wei‐Chung, Lo, Joseph Y., and Glick, Stephen J.. A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom. United States: N. p., 2019.
Web. doi:10.1002/mp.13629.
Ikejimba, Lynda C., Salad, Jesse, Graff, Christian G., Ghammraoui, Bahaa, Cheng, Wei‐Chung, Lo, Joseph Y., & Glick, Stephen J.. A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom. United States. https://doi.org/10.1002/mp.13629
Ikejimba, Lynda C., Salad, Jesse, Graff, Christian G., Ghammraoui, Bahaa, Cheng, Wei‐Chung, Lo, Joseph Y., and Glick, Stephen J.. Fri .
"A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom". United States. https://doi.org/10.1002/mp.13629.
@article{osti_1531187,
title = {A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom},
author = {Ikejimba, Lynda C. and Salad, Jesse and Graff, Christian G. and Ghammraoui, Bahaa and Cheng, Wei‐Chung and Lo, Joseph Y. and Glick, Stephen J.},
abstractNote = {Purpose The advent of three‐dimensional breast imaging systems such as digital breast tomosynthesis (DBT) has great promise for improving the detection and diagnosis of breast cancer. With these new technologies comes an essential need for testing methods to assess the resultant image quality. Although randomized clinical trials are the gold standard for assessing image quality, phantom‐based studies can provide a simpler and less burdensome approach. In this work, a complete framework is presented for task‐based evaluation of microcalcification (MCs) detection performance for DBT imaging systems. Methods The framework consists of three parts. The first part is a realistic anthropomorphic physical breast phantom created through inkjet printing, with parchment paper and iodine‐doped ink. The second is a method for inserting realistic MCs fabricated from calcium hydroxyapatite. The reproducibility and stability of the phantom materials were investigated through multiple samples of parchment and ink over 6 months. The final part is an analysis using a four‐alternative forced choice (4AFC) reader study. To demonstrate the framework, a task‐based 4AFC study was conducted using a clinical system to compare performance from DBT, synthetic mammography (SM), and full‐field digital mammography (FFDM). Nine human observers read images containing MC clusters imaged with all three modalities and tried to correctly locate the MCs. The proportion correct (PC) was measured as the number of correctly detected clusters out of all trials. Results Overall, readers scored the highest with FFDM, (PC = 0.95 ± 0.03) then DBT (0.85 ± 0.04), and finally SM (0.44 ± 0.06). For the parchment and ink samples, the linear attenuation properties were very stable over 6 months. In addition, little difference was found between the various parchment and ink samples, indicating good reproducibility. Conclusions This framework presents a promising methodology for evaluating diagnostic task performance of clinical breast DBT systems.},
doi = {10.1002/mp.13629},
journal = {Medical Physics},
number = 9,
volume = 46,
place = {United States},
year = {2019},
month = {7}
}
https://doi.org/10.1002/mp.13629
Web of Science
Works referenced in this record:
Comparison of Digital Mammography Alone and Digital Mammography Plus Tomosynthesis in a Population-based Screening Program
journal, April 2013
- Skaane, Per; Bandos, Andriy I.; Gullien, Randi
- Radiology, Vol. 267, Issue 1
In silico imaging clinical trials for regulatory evaluation: initial considerations for VICTRE, a demonstration study
conference, March 2017
- Badano, Aldo; Badal, Andreu; Glick, Stephen
- SPIE Medical Imaging, SPIE Proceedings
Evaluation of human observer performance on lesion detectability in single‐slice and multislice dedicated breast cone beam CT images with breast anatomical background
journal, October 2018
- Han, Minah; Jang, Hanjoo; Baek, Jongduk
- Medical Physics, Vol. 45, Issue 12
A novel physical anthropomorphic breast phantom for 2D and 3D x-ray imaging
journal, February 2017
- Ikejimba, Lynda C.; Graff, Christian G.; Rosenthal, Shani
- Medical Physics, Vol. 44, Issue 2
Effectiveness of Digital Breast Tomosynthesis Compared With Digital Mammography: Outcomes Analysis From 3 Years of Breast Cancer Screening
journal, June 2016
- McDonald, Elizabeth S.; Oustimov, Andrew; Weinstein, Susan P.
- JAMA Oncology, Vol. 2, Issue 6
Development of a physical 3D anthropomorphic breast phantom: Development of a 3D anthropomorphic breast phantom
journal, January 2011
- Carton, Ann-Katherine; Bakic, Predrag; Ullberg, Christer
- Medical Physics, Vol. 38, Issue 2
Multi-reader ROC Studies with Split-plot Designs
journal, December 2012
- Obuchowski, Nancy A.; Gallas, Brandon D.; Hillis, Stephen L.
- Academic Radiology, Vol. 19, Issue 12
Design and application of a structured phantom for detection performance comparison between breast tomosynthesis and digital mammography
journal, January 2017
- Cockmartin, L.; Marshall, N. W.; Zhang, G.
- Physics in Medicine and Biology, Vol. 62, Issue 3
Evaluating the sensitivity of the optimization of acquisition geometry to the choice of reconstruction algorithm in digital breast tomosynthesis through a simulation study
journal, January 2015
- Zeng, Rongping; Park, Subok; Bakic, Predrag
- Physics in Medicine and Biology, Vol. 60, Issue 3
Energy weighting improves dose efficiency in clinical practice: implementation on a spectral photon-counting mammography system
journal, August 2014
- Berglund, Johan; Johansson, Henrik; Lundqvist, Mats
- Journal of Medical Imaging, Vol. 1, Issue 3
The randomized trials of breast cancer screening: what have we learned?
journal, September 2004
- Smith, Robert A.; Duffy, Stephen W.; Gabe, Rhian
- Radiologic Clinics of North America, Vol. 42, Issue 5
Digital Breast Tomosynthesis: Observer Performance of Clustered Microcalcification Detection on Breast Phantom Images Acquired with an Experimental System Using Variable Scan Angles, Angular Increments, and Number of Projection Views
journal, December 2014
- Chan, Heang-Ping; Goodsitt, Mitchell M.; Helvie, Mark A.
- Radiology, Vol. 273, Issue 3
A new, open-source, multi-modality digital breast phantom
conference, March 2016
- Graff, Christian G.
- SPIE Medical Imaging, SPIE Proceedings
Digital Breast Tomosynthesis From Concept to Clinical Care
journal, February 2014
- Kopans, Daniel B.
- American Journal of Roentgenology, Vol. 202, Issue 2
Visibility of microcalcification clusters and masses in breast tomosynthesis image volumes and digital mammography: A 4AFC human observer study: Visibility of microcalcifications and masses in breast tomosynthesis
journal, April 2012
- Timberg, P.; Båth, M.; Andersson, I.
- Medical Physics, Vol. 39, Issue 5
TU-CD-207-08: Intrinsic Image Quality Comparison of Synthesized 2-D and FFDM Images
journal, June 2015
- Nelson, J.; Wells, J.; Samei, E.
- Medical Physics, Vol. 42, Issue 6Part33
Assessing task performance in FFDM, DBT, and synthetic mammography using uniform and anthropomorphic physical phantoms: Assessing FFDM, DBT, and SM using two phantoms
journal, September 2016
- Ikejimba, Lynda C.; Glick, Stephen J.; Choudhury, Kingshuk Roy
- Medical Physics, Vol. 43, Issue 10
Radiopaque Three-dimensional Printing: A Method to Create Realistic CT Phantoms
journal, February 2017
- Jahnke, Paul; Limberg, Felix R. P.; Gerbl, Andreas
- Radiology, Vol. 282, Issue 2
Comparison of the x-ray attenuation properties of breast calcifications, aluminium, hydroxyapatite and calcium oxalate
journal, March 2013
- Warren, L. M.; Mackenzie, A.; Dance, D. R.
- Physics in Medicine and Biology, Vol. 58, Issue 7
Breast cancer statistics, 2015: Convergence of incidence rates between black and white women: Breast Cancer Statistics, 2015
journal, October 2015
- DeSantis, Carol E.; Fedewa, Stacey A.; Goding Sauer, Ann
- CA: A Cancer Journal for Clinicians, Vol. 66, Issue 1
Development and validation of a modelling framework for simulating 2D-mammography and breast tomosynthesis images
journal, July 2014
- Elangovan, Premkumar; Warren, Lucy M.; Mackenzie, Alistair
- Physics in Medicine and Biology, Vol. 59, Issue 15