Visualizing the Uncertainty of Graph-based 2D Segmentation with Min-path Stability

Summa, B.; Tierny, J.; Pascucci, V.

doi:10.1111/cgf.13174

Title: Visualizing the Uncertainty of Graph-based 2D Segmentation with Min-path Stability

Journal Article · Tue Jul 04 00:00:00 EDT 2017 · Computer Graphics Forum

DOI:https://doi.org/10.1111/cgf.13174· OSTI ID:1418630

Summa, B. ^[1]; Tierny, J. ^[2]; Pascucci, V. ^[3]

Tulane Univ., New Orleans, LA (United States)
Sorbonne Univ., Paris (France)
Univ. of Utah, Salt Lake City, UT (United States)

This paper presents a novel approach to visualize the uncertainty in graph-based segmentations of scalar data. Segmentation of 2D scalar data has wide application in a variety of scientific and medical domains. Typically, a segmentation is presented as a single unambiguous boundary although the solution is often uncertain due to noise or blur in the underlying data as well as imprecision in user input. Our approach provides insight into this uncertainty by computing the “min-path stability”, a scalar measure analyzing the stability of the segmentation given a set of input constraints. Our approach is efficient, easy to compute, and can be generally applied to either graph cuts or live-wire (even partial) segmentations. In addition to its general applicability, our new approach to graph cuts uncertainty visualization improves on the time complexity of the current state-oft-the-art with an additional fast approximate solution. We also introduce a novel query enabled by our approach which provides users with alternate segmentations by efficiently extracting local minima of the segmentation optimization. Finally, we evaluate our approach and demonstrate its utility on data from scientific and medical applications.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Univ. of Utah, Salt Lake City, UT (United States)

Sponsoring Organization:: National Science Foundation (NSF); USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: NA0002375; SC0007446

OSTI ID:: 1418630

Alternate ID(s):: OSTI ID: 1756071

Journal Information:: Computer Graphics Forum, Vol. 36, Issue 3; ISSN 0167-7055

Publisher:: WileyCopyright Statement

Country of Publication:: United States

Language:: English

Citation Metrics:

Cited by: 5 works

Citation information provided by
Web of Science

References (27)

Minimum s - t Cut of a Planar Undirected Network in $O(n\log ^2 (n))$ Time Reif, John H. SIAM Journal on Computing, Vol. 12, Issue 1 https://doi.org/10.1137/0212005	journal	February 1983
Gigapixel surface imaging of radical prostatectomy specimens for comprehensive detection of cancer-positive surgical margins using structured illumination microscopy Wang, Mei; Tulman, David B.; Sholl, Andrew B. Scientific Reports, Vol. 6, Issue 1 https://doi.org/10.1038/srep27419	journal	June 2016
An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision Boykov, Y.; Kolmogorov, V. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 26, Issue 9 https://doi.org/10.1109/TPAMI.2004.60	journal	September 2004
Maximum Flow in Planar Networks Itai, Alon; Shiloach, Yossi SIAM Journal on Computing, Vol. 8, Issue 2 https://doi.org/10.1137/0208012	journal	May 1979
CandidTree: Visualizing Structural Uncertainty in Similar Hierarchies Lee, Bongshin; Robertson, George G.; Czerwinski, Mary Information Visualization, Vol. 6, Issue 3 https://doi.org/10.1057/palgrave.ivs.9500157	journal	September 2007
Lazy snapping Li, Yin; Sun, Jian; Tang, Chi-Keung ACM Transactions on Graphics, Vol. 23, Issue 3 https://doi.org/10.1145/1015706.1015719	journal	August 2004
A note on two problems in connexion with graphs Dijkstra, E. W. Numerische Mathematik, Vol. 1, Issue 1 https://doi.org/10.1007/BF01386390	journal	December 1959
Vessel architectural imaging identifies cancer patient responders to anti-angiogenic therapy Emblem, Kyrre E.; Mouridsen, Kim; Bjornerud, Atle Nature Medicine, Vol. 19, Issue 9 https://doi.org/10.1038/nm.3289	journal	August 2013
Random Walks for Image Segmentation Grady, L. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 28, Issue 11 https://doi.org/10.1109/TPAMI.2006.233	journal	November 2006
Panorama weaving: fast and flexible seam processing Summa, Brian; Tierny, Julien; Pascucci, Valerio ACM Transactions on Graphics, Vol. 31, Issue 4 https://doi.org/10.1145/2185520.2185579	journal	July 2012
Fast approximate energy minimization via graph cuts Boykov, Y.; Veksler, O.; Zabih, R. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 23, Issue 11 https://doi.org/10.1109/34.969114	journal	January 2001
Diverse M-Best Solutions in Markov Random Fields Batra, Dhruv; Yadollahpour, Payman; Guzman-Rivera, Abner Computer Vision – ECCV 2012 https://doi.org/10.1007/978-3-642-33715-4_1	book	January 2012
3D Variational Brain Tumor Segmentation using a High Dimensional Feature Set Cobzas, Dana; Birkbeck, Neil; Schmidt, Mark 2007 IEEE 11th International Conference on Computer Vision https://doi.org/10.1109/ICCV.2007.4409130	conference	October 2007
Automatic Heart Isolation for CT Coronary Visualization Using Graph-Cuts Funka-Lea, G.; Boykov, Y.; Florin, C. 3rd IEEE International Symposium on Biomedical Imaging: Macro to Nano, 2006. https://doi.org/10.1109/ISBI.2006.1624991	conference	January 2006
Level-set evolution with region competition: automatic 3-D segmentation of brain tumors Ho, S.; Bullitt, E.; Gerig, G. 16th International Conference on Pattern Recognition, Object recognition supported by user interaction for service robots https://doi.org/10.1109/ICPR.2002.1044788	conference	January 2002
Interactive seismic interpretation with piecewise global energy minimization Hollt, Thomas; Beyer, Johanna; Gschwantner, Fritz 2011 IEEE Pacific Visualization Symposium (PacificVis) https://doi.org/10.1109/PACIFICVIS.2011.5742373	conference	March 2011
Sketch-Based Editing Tools for Tumour Segmentation in 3D Medical Images: Sketch-Based Editing Tools for Tumor Segmentation Heckel, Frank; Moltz, Jan H.; Tietjen, Christian Computer Graphics Forum, Vol. 32, Issue 8 https://doi.org/10.1111/cgf.12193	journal	August 2013
Interactive graph cut segmentation of touching neuronal structures from electron micrographs Jagadeesh, Vignesh; Manjunath, B. S. 2010 17th IEEE International Conference on Image Processing (ICIP 2010), 2010 IEEE International Conference on Image Processing https://doi.org/10.1109/ICIP.2010.5652042	conference	September 2010
A novel nested graph cuts method for segmenting human lymph nodes in 3D high frequency ultrasound images Kuo, Jen-wei; Mamou, Jonathan; Wang, Yao 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI 2015), 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI) https://doi.org/10.1109/ISBI.2015.7163890	conference	April 2015
Probabilistic Marching Cubes Pöthkow, Kai; Weber, Britta; Hege, Hans-Christian Computer Graphics Forum, Vol. 30, Issue 3 https://doi.org/10.1111/j.1467-8659.2011.01942.x	journal	June 2011
A Seeded Image Segmentation Framework Unifying Graph Cuts And Random Walker Which Yields A New Algorithm Sinop, Ali Kemal; Grady, Leo 2007 IEEE 11th International Conference on Computer Vision https://doi.org/10.1109/ICCV.2007.4408927	conference	October 2007
Seeded watershed cut uncertainty estimators for guided interactive segmentation Straehle, C.; Koethe, U.; Knott, G. 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2012.6247747	conference	June 2012
ProbExplorer: Uncertainty-guided Exploration and Editing of Probabilistic Medical Image Segmentation Saad, Ahmed; Möller, Torsten; Hamarneh, Ghassan Computer Graphics Forum, Vol. 29, Issue 3 https://doi.org/10.1111/j.1467-8659.2009.01691.x	journal	June 2010
Survey over image thresholding techniques and quantitative performance evaluation Sankur, Bu¨lent Journal of Electronic Imaging, Vol. 13, Issue 1 https://doi.org/10.1117/1.1631315	journal	January 2004
Efficient planar graph cuts with applications in Computer Vision Schmidt, Frank R.; Toppe, Eno; Cremers, Daniel 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), 2009 IEEE Conference on Computer Vision and Pattern Recognition https://doi.org/10.1109/CVPR.2009.5206863	conference	June 2009
Revisiting uncertainty in graph cut solutions Tarlow, D.; Adams, R. P. 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) https://doi.org/10.1109/CVPR.2012.6247958	conference	June 2012
Interactive grain image segmentation using graph cut algorithms Waggoner, Jarrell; Zhou, Youjie; Simmons, Jeff IS&T/SPIE Electronic Imaging, SPIE Proceedings https://doi.org/10.1117/12.2014161	conference	February 2013