skip to main content

DOE PAGESDOE PAGES

Title: Visualization and Analysis for Near-Real-Time Decision Making in Distributed Workflows

Data driven science is becoming increasingly more common, complex, and is placing tremendous stresses on visualization and analysis frameworks. Data sources producing 10GB per second (and more) are becoming increasingly commonplace in both simulation, sensor and experimental sciences. These data sources, which are often distributed around the world, must be analyzed by teams of scientists that are also distributed. Enabling scientists to view, query and interact with such large volumes of data in near-real-time requires a rich fusion of visualization and analysis techniques, middleware and workflow systems. Here, this paper discusses initial research into visualization and analysis of distributed data workflows that enables scientists to make near-real-time decisions of large volumes of time varying data.
Authors:
 [1] ;  [2] ;  [1] ;  [1] ;  [3] ;  [4] ;  [5] ;  [5] ;  [6] ;  [7] ;  [7] ;  [7] ;  [8]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  2. Univ. of Oregon, Eugene, OR (United States); Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  3. Stony Brook Univ., NY (United States); Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
  4. Princeton Plasma Physics Lab. (PPPL), Princeton, NJ (United States)
  5. Georgia Inst. of Technology, Atlanta, GA (United States)
  6. Univ. of Oregon, Eugene, OR (United States); Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  7. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  8. A*STAR Computational Resource Centre
Publication Date:
Grant/Contract Number:
AC02-05CH11231
Type:
Accepted Manuscript
Journal Name:
Proceedings - 2016 IEEE 30th International Parallel and Distributed Processing Symposium, IPDPS 2016
Additional Journal Information:
Conference: 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), Chicago, IL (United States), 23-27 May 2016
Research Org:
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Sponsoring Org:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; Data visualization; Data models; Computational modeling; Distributed databases; Plasmas; Middleware; Wide area networks
OSTI Identifier:
1379523