Feature-based analysis of large-scale spatio-temporal sensor data on hybrid architectures

Saltz, Joel H.; Teodoro, George; Pan, Tony; Cooper, Lee A. D.; Kong, Jun; Klasky, Scott; Kurc, Tahsin M.

doi:10.1177/1094342013488260

Feature-based analysis of large-scale spatio-temporal sensor data on hybrid architectures

Journal Article · 08 June 2013 · International Journal of High Performance Computing Applications

DOI:https://doi.org/10.1177/1094342013488260· OSTI ID:1565093

Saltz, Joel H. ^[1]; Teodoro, George ^[1]; Pan, Tony ^[1]; Cooper, Lee A. D. ^[1]; Kong, Jun ^[1]; Klasky, Scott ^[2]; Kurc, Tahsin M. ^[3]

Emory Univ., Atlanta, GA (United States). Center for Comprehensive Informatics and Biomedical Informatics Dept.
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Scientific Data Group
Emory Univ., Atlanta, GA (United States). Center for Comprehensive Informatics and Biomedical Informatics Dept.; Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States). Scientific Data Group

The analysis of large sensor datasets for structural and functional features has applications in many domains, including weather and climate modeling, characterization of subsurface reservoirs, and biomedicine. The vast amount of data obtained from state-of-the-art sensors and the computational cost of analysis operations create a barrier to such analyses. In this paper, we describe middleware system support to take advantage of large clusters of hybrid CPU–GPU nodes to address the data and compute-intensive requirements of feature-based analyses of large spatio-temporal datasets.

View Accepted Manuscript (DOE)

Research Organization:: Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)

Sponsoring Organization:: USDOE Office of Science (SC)

OSTI ID:: 1565093

Journal Information:: International Journal of High Performance Computing Applications, Journal Name: International Journal of High Performance Computing Applications Journal Issue: 3 Vol. 27; ISSN 1094-3420

Publisher:: SAGECopyright Statement

Country of Publication:: United States

Language:: English

References (21)

Optimizing retrieval and processing of multi-dimensional scientific datasets No authors listed Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000 https://doi.org/10.1109/IPDPS.2000.846013	conference	January 2000
Biomedical image analysis on a cooperative cluster of GPUs and multicores Hartley, Timothy D. R.; Catalyurek, Umit; Ruiz, Antonio Proceedings of the 22nd annual international conference on Supercomputing - ICS '08 https://doi.org/10.1145/1375527.1375533	conference	January 2008
StarPU: a unified platform for task scheduling on heterogeneous multicore architectures Augonnet, Cédric; Thibault, Samuel; Namyst, Raymond Concurrency and Computation: Practice and Experience, Vol. 23, Issue 2 https://doi.org/10.1002/cpe.1631	journal	November 2010
Distributed processing of very large datasets with DataCutter Beynon, Michael D.; Kurc, Tahsin; Catalyurek, Umit Parallel Computing, Vol. 27, Issue 11 https://doi.org/10.1016/S0167-8191(01)00099-0	journal	October 2001
DataStager: scalable data staging services for petascale applications Abbasi, Hasan; Wolf, Matthew; Eisenhauer, Greg Cluster Computing, Vol. 13, Issue 3 https://doi.org/10.1007/s10586-010-0135-6	journal	June 2010
:{Consensus Clustering: A Resampling-Based Method for Class Discovery and Visualization of Gene Expression Microarray Data Monti, Stefano Machine Learning, Vol. 52, Issue 1/2, p. 91-118 https://doi.org/10.1023/A:1023949509487	journal	January 2003
A scalable gaussian process analysis algorithm for biomass monitoring Chandola, Varun; Vatsavai, Ranga Raju Statistical Analysis and Data Mining, Vol. 4, Issue 4 https://doi.org/10.1002/sam.10129	journal	July 2011
Flexible IO and integration for scientific codes through the adaptable IO system (ADIOS) Lofstead, Jay F.; Klasky, Scott; Schwan, Karsten Proceedings of the 6th international workshop on Challenges of large applications in distributed environments - CLADE '08 https://doi.org/10.1145/1383529.1383533	conference	January 2008
Cluster I/O with River: making the fast case common Arpaci-Dusseau, Remzi H.; Anderson, Eric; Treuhaft, Noah Proceedings of the sixth workshop on I/O in parallel and distributed systems - IOPADS '99 https://doi.org/10.1145/301816.301823	conference	January 1999
Keeneland: Bringing Heterogeneous GPU Computing to the Computational Science Community Vetter, Jeffrey S.; Glassbrook, Richard; Dongarra, Jack Computing in Science & Engineering, Vol. 13, Issue 5 https://doi.org/10.1109/MCSE.2011.83	journal	September 2011
High-throughput Analysis of Large Microscopy Image Datasets on CPU-GPU Cluster Platforms Teodoro, George; Pan, Tony; Kurc, Tahsin M. 2013 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), 2013 IEEE 27th International Symposium on Parallel and Distributed Processing https://doi.org/10.1109/IPDPS.2013.11	conference	May 2013
Run-time optimizations for replicated dataflows on heterogeneous environments Teodoro, George; Hartley, Timothy D. R.; Catalyurek, Umit Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing - HPDC '10 https://doi.org/10.1145/1851476.1851479	conference	January 2010
MapReduce: a flexible data processing tool Dean, Jeffrey; Ghemawat, Sanjay Communications of the ACM, Vol. 53, Issue 1 https://doi.org/10.1145/1629175.1629198	journal	January 2010
Morphological signatures and genomic correlates in glioblastoma Cooper, Lee A. D.; Kong, Jun; Wang, Fusheng 2011 8th IEEE International Symposium on Biomedical Imaging (ISBI 2011), 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro https://doi.org/10.1109/ISBI.2011.5872714	conference	March 2011
A K-Means Cluster Analysis Computer Program With Cross-Tabulations and Next-Nearest-Neighbor Analysis Lee, Howard B.; Macqueen, James B. Educational and Psychological Measurement, Vol. 40, Issue 1 https://doi.org/10.1177/001316448004000118	journal	April 1980
DAGuE: A generic distributed DAG engine for High Performance Computing Bosilca, George; Bouteiller, Aurelien; Danalis, Anthony Parallel Computing, Vol. 38, Issue 1-2 https://doi.org/10.1016/j.parco.2011.10.003	journal	January 2012
Accelerating Large Scale Image Analyses on Parallel, CPU-GPU Equipped Systems Teodoro, George; Kurc, Tahsin M.; Pan, Tony 2012 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), 2012 IEEE 26th International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2012.101	conference	May 2012
DataSpaces: an interaction and coordination framework for coupled simulation workflows Docan, Ciprian; Parashar, Manish; Klasky, Scott Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing - HPDC '10 https://doi.org/10.1145/1851476.1851481	conference	January 2010
A parallel software infrastructure for structured adaptive mesh methods Kohn, Scott R.; Baden, Scott B. Proceedings of the 1995 ACM/IEEE conference on Supercomputing (CDROM) - Supercomputing '95 https://doi.org/10.1145/224170.224283	conference	January 1995
An Integrative Approach for In Silico Glioma Research Cooper, Lee A. D.; Gutman, David A. IEEE Transactions on Biomedical Engineering, Vol. 57, Issue 10 https://doi.org/10.1109/TBME.2010.2060338	journal	October 2010
Enabling Interoperation of High Performance, Scientific Computing Applications: Modeling Scientific Data with the Sets and Fields (SAF) Modeling System Miller, Mark C.; Reus, James F.; Matzke, Robb P. Computational Science - ICCS 2001 https://doi.org/10.1007/3-540-45718-6_18	book	January 2001

Similar Records

Parallel Multivariate Spatio-Temporal Clustering of Large Ecological Datasets on Hybrid Supercomputers

Conference · 2017 · OSTI ID:1399976

Sreepathi, Sarat; Kumar, Jitendra; Mills, Richard T.; +3 more

Towards Real-Time Detection and Tracking of Spatio-Temporal Features: Blob-Filaments in Fusion Plasma [Spatio-Temporal Features in Large Irregular Data: Blob-Filaments in Fusion Plasma]

Journal Article · 2016 · IEEE Transactions on Big Data · OSTI ID:1377450

Wu, Lingfei; Wu, Kesheng John; Sim, Alex; +5 more

The Anatomy of Mr. Scan: A Dissection of Performance of an Extreme Scale GPU-Based Clustering Algorithm, In: 2014 5th Workshop on Latest Advances in Scalable Algorithms for Large-Scale Systems

Conference · 2014 · 2014 5TH WORKSHOP ON LATEST ADVANCES IN SCALABLE ALGORITHMS FOR LARGE-SCALE SYSTEMS (SCALA) · OSTI ID:1567375

Welton, Benjamin; Miller, Barton P.

Related Subjects

97 MATHEMATICS AND COMPUTING
Computer Science

Feature-based analysis of large-scale spatio-temporal sensor data on hybrid architectures

Citation Formats

References (21)

Similar Records

Related Subjects