skip to main content

DOE PAGESDOE PAGES

Title: Data streaming for metabolomics: Accelerating data processing and analysis from days to minutes

The speed and throughput of analytical platforms has been a driving force in recent years in the “omics” technologies and while great strides have been accomplished in both chromatography and mass spectrometry, data analysis times have not benefited at the same pace. Even though personal computers have become more powerful, data transfer times still represent a bottleneck in data processing because of the increasingly complex data files and studies with a greater number of samples. To meet the demand of analyzing hundreds to thousands of samples within a given experiment, we have developed a data streaming platform, XCMS Stream, which capitalizes on the acquisition time to compress and stream recently acquired data files to data processing servers, mimicking just-in-time production strategies from the manufacturing industry. The utility of this XCMS Online-based technology is demonstrated here in the analysis of T cell metabolism and other large-scale metabolomic studies. A large scale example on a 1000 sample data set demonstrated a 10 000-fold time savings, reducing data analysis time from days to minutes. Here, XCMS Stream has the capability to increase the efficiency of downstream biochemical dependent data acquisition (BDDA) analysis by initiating data conversion and data processing on subsets of datamore » acquired, expanding its application beyond data transfer to smart preliminary data decision-making prior to full acquisition.« less
Authors:
ORCiD logo [1] ;  [1] ;  [1] ;  [1] ;  [1] ;  [1] ; ORCiD logo [1] ; ORCiD logo [1] ;  [1] ;  [2] ;  [1] ;  [1] ;  [1] ;  [1]
  1. The Scripps Research Institute, La Jolla, CA (United States)
  2. Univ. of Lausanne, Lausanne (Switzerland)
Publication Date:
Grant/Contract Number:
AC02-05CH11231
Type:
Published Article
Journal Name:
Analytical Chemistry
Additional Journal Information:
Journal Volume: 89; Journal Issue: 2; Journal ID: ISSN 0003-2700
Publisher:
American Chemical Society (ACS)
Research Org:
The Scripps Research Inst., La Jolla, CA (United States)
Sponsoring Org:
USDOE Office of Science (SC), Biological and Environmental Research (BER) (SC-23)
Country of Publication:
United States
Language:
English
Subject:
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY
OSTI Identifier:
1337887
Alternate Identifier(s):
OSTI ID: 1339957