A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom

Ikejimba, Lynda C.; Salad, Jesse; Graff, Christian G.; Ghammraoui, Bahaa; Cheng, Wei‐Chung; Lo, Joseph Y.; Glick, Stephen J.

doi:10.1002/mp.13629

A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom

Journal Article · Fri Jul 05 00:00:00 EDT 2019 · Medical Physics

DOI:https://doi.org/10.1002/mp.13629· OSTI ID:1531187

Ikejimba, Lynda C. ^[1]; Salad, Jesse ^[1]; Graff, Christian G. ^[1]; Ghammraoui, Bahaa ^[1]; Cheng, Wei‐Chung ^[1]; Lo, Joseph Y. ^[2]; Glick, Stephen J. ^[1]

US Food and Drug Administration 10903 New Hampshire Ave Silver Spring MD 20993 USA
Medical Physics Graduate Program Duke University 2424 Erwin Road Durham NC 27705 USA

Purpose

The advent of three‐dimensional breast imaging systems such as digital breast tomosynthesis (DBT) has great promise for improving the detection and diagnosis of breast cancer. With these new technologies comes an essential need for testing methods to assess the resultant image quality. Although randomized clinical trials are the gold standard for assessing image quality, phantom‐based studies can provide a simpler and less burdensome approach. In this work, a complete framework is presented for task‐based evaluation of microcalcification (MCs) detection performance for DBT imaging systems.

Methods

The framework consists of three parts. The first part is a realistic anthropomorphic physical breast phantom created through inkjet printing, with parchment paper and iodine‐doped ink. The second is a method for inserting realistic MCs fabricated from calcium hydroxyapatite. The reproducibility and stability of the phantom materials were investigated through multiple samples of parchment and ink over 6 months. The final part is an analysis using a four‐alternative forced choice (4AFC) reader study. To demonstrate the framework, a task‐based 4AFC study was conducted using a clinical system to compare performance from DBT, synthetic mammography (SM), and full‐field digital mammography (FFDM). Nine human observers read images containing MC clusters imaged with all three modalities and tried to correctly locate the MCs. The proportion correct (PC) was measured as the number of correctly detected clusters out of all trials.

Results

Overall, readers scored the highest with FFDM, (PC = 0.95 ± 0.03) then DBT (0.85 ± 0.04), and finally SM (0.44 ± 0.06). For the parchment and ink samples, the linear attenuation properties were very stable over 6 months. In addition, little difference was found between the various parchment and ink samples, indicating good reproducibility.

Conclusions

This framework presents a promising methodology for evaluating diagnostic task performance of clinical breast DBT systems.

View Accepted Manuscript (Publisher)

Sponsoring Organization:: USDOE

OSTI ID:: 1531187

Journal Information:: Medical Physics, Journal Name: Medical Physics Journal Issue: 9 Vol. 46; ISSN 0094-2405

Publisher:: Wiley Blackwell (John Wiley & Sons)Copyright Statement

Country of Publication:: United States

Language:: English

References (21)

Effectiveness of Digital Breast Tomosynthesis Compared With Digital Mammography: Outcomes Analysis From 3 Years of Breast Cancer Screening McDonald, Elizabeth S.; Oustimov, Andrew; Weinstein, Susan P. JAMA Oncology, Vol. 2, Issue 6 https://doi.org/10.1001/jamaoncol.2015.5536	journal	June 2016
A novel physical anthropomorphic breast phantom for 2D and 3D x-ray imaging Ikejimba, Lynda C.; Graff, Christian G.; Rosenthal, Shani Medical Physics, Vol. 44, Issue 2 https://doi.org/10.1002/mp.12062	journal	February 2017
Evaluation of human observer performance on lesion detectability in single‐slice and multislice dedicated breast cone beam CT images with breast anatomical background Han, Minah; Jang, Hanjoo; Baek, Jongduk Medical Physics, Vol. 45, Issue 12 https://doi.org/10.1002/mp.13220	journal	October 2018
Multi-reader ROC Studies with Split-plot Designs Obuchowski, Nancy A.; Gallas, Brandon D.; Hillis, Stephen L. Academic Radiology, Vol. 19, Issue 12 https://doi.org/10.1016/j.acra.2012.09.012	journal	December 2012
The randomized trials of breast cancer screening: what have we learned? Smith, Robert A.; Duffy, Stephen W.; Gabe, Rhian Radiologic Clinics of North America, Vol. 42, Issue 5 https://doi.org/10.1016/j.rcl.2004.06.014	journal	September 2004
Comparison of the x-ray attenuation properties of breast calcifications, aluminium, hydroxyapatite and calcium oxalate Warren, L. M.; Mackenzie, A.; Dance, D. R. Physics in Medicine and Biology, Vol. 58, Issue 7 https://doi.org/10.1088/0031-9155/58/7/N103	journal	March 2013
Development and validation of a modelling framework for simulating 2D-mammography and breast tomosynthesis images Elangovan, Premkumar; Warren, Lucy M.; Mackenzie, Alistair Physics in Medicine and Biology, Vol. 59, Issue 15 https://doi.org/10.1088/0031-9155/59/15/4275	journal	July 2014
Evaluating the sensitivity of the optimization of acquisition geometry to the choice of reconstruction algorithm in digital breast tomosynthesis through a simulation study Zeng, Rongping; Park, Subok; Bakic, Predrag Physics in Medicine and Biology, Vol. 60, Issue 3 https://doi.org/10.1088/0031-9155/60/3/1259	journal	January 2015
Design and application of a structured phantom for detection performance comparison between breast tomosynthesis and digital mammography Cockmartin, L.; Marshall, N. W.; Zhang, G. Physics in Medicine and Biology, Vol. 62, Issue 3 https://doi.org/10.1088/1361-6560/aa5407	journal	January 2017
Energy weighting improves dose efficiency in clinical practice: implementation on a spectral photon-counting mammography system Berglund, Johan; Johansson, Henrik; Lundqvist, Mats Journal of Medical Imaging, Vol. 1, Issue 3 https://doi.org/10.1117/1.JMI.1.3.031003	journal	August 2014
A new, open-source, multi-modality digital breast phantom Graff, Christian G. SPIE Medical Imaging, SPIE Proceedings https://doi.org/10.1117/12.2216312	conference	March 2016
In silico imaging clinical trials for regulatory evaluation: initial considerations for VICTRE, a demonstration study Badano, Aldo; Badal, Andreu; Glick, Stephen SPIE Medical Imaging, SPIE Proceedings https://doi.org/10.1117/12.2255746	conference	March 2017
Development of a physical 3D anthropomorphic breast phantom: Development of a 3D anthropomorphic breast phantom Carton, Ann-Katherine; Bakic, Predrag; Ullberg, Christer Medical Physics, Vol. 38, Issue 2 https://doi.org/10.1118/1.3533896	journal	January 2011
Visibility of microcalcification clusters and masses in breast tomosynthesis image volumes and digital mammography: A 4AFC human observer study: Visibility of microcalcifications and masses in breast tomosynthesis Timberg, P.; Båth, M.; Andersson, I. Medical Physics, Vol. 39, Issue 5 https://doi.org/10.1118/1.3694105	journal	April 2012
TU-CD-207-08: Intrinsic Image Quality Comparison of Synthesized 2-D and FFDM Images Nelson, J.; Wells, J.; Samei, E. Medical Physics, Vol. 42, Issue 6Part33 https://doi.org/10.1118/1.4925627	journal	June 2015
Assessing task performance in FFDM, DBT, and synthetic mammography using uniform and anthropomorphic physical phantoms: Assessing FFDM, DBT, and SM using two phantoms Ikejimba, Lynda C.; Glick, Stephen J.; Choudhury, Kingshuk Roy Medical Physics, Vol. 43, Issue 10 https://doi.org/10.1118/1.4962475	journal	September 2016
Comparison of Digital Mammography Alone and Digital Mammography Plus Tomosynthesis in a Population-based Screening Program Skaane, Per; Bandos, Andriy I.; Gullien, Randi Radiology, Vol. 267, Issue 1 https://doi.org/10.1148/radiol.12121373	journal	April 2013
Digital Breast Tomosynthesis: Observer Performance of Clustered Microcalcification Detection on Breast Phantom Images Acquired with an Experimental System Using Variable Scan Angles, Angular Increments, and Number of Projection Views Chan, Heang-Ping; Goodsitt, Mitchell M.; Helvie, Mark A. Radiology, Vol. 273, Issue 3 https://doi.org/10.1148/radiol.14132722	journal	December 2014
Radiopaque Three-dimensional Printing: A Method to Create Realistic CT Phantoms Jahnke, Paul; Limberg, Felix R. P.; Gerbl, Andreas Radiology, Vol. 282, Issue 2 https://doi.org/10.1148/radiol.2016152710	journal	February 2017
Digital Breast Tomosynthesis From Concept to Clinical Care Kopans, Daniel B. American Journal of Roentgenology, Vol. 202, Issue 2 https://doi.org/10.2214/AJR.13.11520	journal	February 2014
Breast cancer statistics, 2015: Convergence of incidence rates between black and white women: Breast Cancer Statistics, 2015 DeSantis, Carol E.; Fedewa, Stacey A.; Goding Sauer, Ann CA: A Cancer Journal for Clinicians, Vol. 66, Issue 1 https://doi.org/10.3322/caac.21320	journal	October 2015

Similar Records

Assessment of task‐based performance from five clinical DBT systems using an anthropomorphic breast phantom

Journal Article · Wed Jan 27 19:00:00 EST 2021 · Medical Physics · OSTI ID:1804834

Assessing task performance in FFDM, DBT, and synthetic mammography using uniform and anthropomorphic physical phantoms

Journal Article · Thu Sep 22 20:00:00 EDT 2016 · Medical Physics · OSTI ID:1401483

How does C-VIEW image quality compare with conventional 2D FFDM?

Journal Article · Sun May 15 00:00:00 EDT 2016 · Medical Physics · OSTI ID:22620904

A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom

Citation Formats

References (21)

Similar Records

Related Subjects