skip to main content

DOE PAGESDOE PAGES

This content will become publicly available on April 1, 2019

Title: TokSearch: A search engine for fusion experimental data

At a typical fusion research site, experimental data is stored using archive technologies that deal with each discharge as an independent set of data. These technologies (e.g. MDSplus or HDF5) are typically supplemented with a database that aggregates metadata for multiple shots to allow for efficient querying of certain predefined quantities. Often, however, a researcher will need to extract information from the archives, possibly for many shots, that is not available in the metadata store or otherwise indexed for quick retrieval. To address this need, a new search tool called TokSearch has been added to the General Atomics TokSys control design and analysis suite [1]. This tool provides the ability to rapidly perform arbitrary, parallelized queries of archived tokamak shot data (both raw and analyzed) over large numbers of shots. The TokSearch query API borrows concepts from SQL, and users can choose to implement queries in either MatlabTM or Python.
Authors:
 [1] ;  [1] ;  [1] ;  [1] ;  [1] ;  [1] ;  [1]
  1. General Atomics, San Diego, CA (United States)
Publication Date:
Grant/Contract Number:
FC02-04ER54698
Type:
Accepted Manuscript
Journal Name:
Fusion Engineering and Design
Additional Journal Information:
Journal Volume: 129; Journal Issue: C; Journal ID: ISSN 0920-3796
Publisher:
Elsevier
Research Org:
Dept. of Energy (DOE), Washington DC (United States)
Sponsoring Org:
USDOE
Country of Publication:
United States
Language:
English
Subject:
70 PLASMA PHYSICS AND FUSION TECHNOLOGY; 96 KNOWLEDGE MANAGEMENT AND PRESERVATION
OSTI Identifier:
1436502

Sammuli, Brian S., Barr, Jayson L., Eidietis, Nicholas W., Olofsson, Erik E. J., Flanagan, Sean M., Kostuk, Mark, and Humphreys, David A.. TokSearch: A search engine for fusion experimental data. United States: N. p., Web. doi:10.1016/j.fusengdes.2018.02.003.
Sammuli, Brian S., Barr, Jayson L., Eidietis, Nicholas W., Olofsson, Erik E. J., Flanagan, Sean M., Kostuk, Mark, & Humphreys, David A.. TokSearch: A search engine for fusion experimental data. United States. doi:10.1016/j.fusengdes.2018.02.003.
Sammuli, Brian S., Barr, Jayson L., Eidietis, Nicholas W., Olofsson, Erik E. J., Flanagan, Sean M., Kostuk, Mark, and Humphreys, David A.. 2018. "TokSearch: A search engine for fusion experimental data". United States. doi:10.1016/j.fusengdes.2018.02.003.
@article{osti_1436502,
title = {TokSearch: A search engine for fusion experimental data},
author = {Sammuli, Brian S. and Barr, Jayson L. and Eidietis, Nicholas W. and Olofsson, Erik E. J. and Flanagan, Sean M. and Kostuk, Mark and Humphreys, David A.},
abstractNote = {At a typical fusion research site, experimental data is stored using archive technologies that deal with each discharge as an independent set of data. These technologies (e.g. MDSplus or HDF5) are typically supplemented with a database that aggregates metadata for multiple shots to allow for efficient querying of certain predefined quantities. Often, however, a researcher will need to extract information from the archives, possibly for many shots, that is not available in the metadata store or otherwise indexed for quick retrieval. To address this need, a new search tool called TokSearch has been added to the General Atomics TokSys control design and analysis suite [1]. This tool provides the ability to rapidly perform arbitrary, parallelized queries of archived tokamak shot data (both raw and analyzed) over large numbers of shots. The TokSearch query API borrows concepts from SQL, and users can choose to implement queries in either MatlabTM or Python.},
doi = {10.1016/j.fusengdes.2018.02.003},
journal = {Fusion Engineering and Design},
number = C,
volume = 129,
place = {United States},
year = {2018},
month = {4}
}