CMed: Crowd Analytics for Medical Imaging Data
Journal Article
·
· IEEE Transactions on Visualization and Computer Graphics
- Brookhaven National Lab. (BNL), Upton, NY (United States)
- Memorial Sloan Kettering Cancer Center, New York, NY (United States). Sloan Kettering Institute
- Stony Brook Univ., NY (United States)
In this work, we present a visual analytics framework, CMed, for exploring medical image data annotations acquired from crowdsourcing. CMed can be used to visualize, classify, and filter crowdsourced clinical data based on a number of different metrics such as detection rate, logged events, and clustering of the annotations. CMed provides several interactive linked visualization components to analyze the crowd annotation results for a particular video and the associated workers. Additionally, all results of an individual worker can be inspected using multiple linked views in our CMed framework. We allow a crowdsourcing application analyst to observe patterns and gather insights into the crowdsourced medical data, helping him/her design future crowdsourcing applications for optimal output from the workers. We demonstrate the efficacy of our framework with two medical crowdsourcing studies: polyp detection in virtual colonoscopy videos and lung nodule detection in CT thin-slab maximum intensity projection videos. We also provide experts' feedback to show the effectiveness of our framework. Lastly, we share the lessons we learned from our framework with suggestions for integrating our framework into a clinical workflow.
- Research Organization:
- Brookhaven National Laboratory (BNL), Upton, NY (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research; National Science Foundation (NSF)
- Grant/Contract Number:
- SC0012704
- OSTI ID:
- 1677652
- Report Number(s):
- BNL--219939-2020-JAAM
- Journal Information:
- IEEE Transactions on Visualization and Computer Graphics, Journal Name: IEEE Transactions on Visualization and Computer Graphics Journal Issue: 6 Vol. 27; ISSN 1077-2626
- Publisher:
- IEEECopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Improve Learning from Crowds via Generative Augmentation
Learning from Crowds by Modeling Common Confusions
Learning from crowds with variational Gaussian processes
Conference
·
Sat Aug 14 00:00:00 EDT 2021
· Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining
·
OSTI ID:1822655
Learning from Crowds by Modeling Common Confusions
Conference
·
Mon Feb 08 23:00:00 EST 2021
·
OSTI ID:1822656
Learning from crowds with variational Gaussian processes
Journal Article
·
Mon Nov 19 23:00:00 EST 2018
· Pattern Recognition
·
OSTI ID:1488416