skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: TokSearch: A search engine for fusion experimental data

Abstract

At a typical fusion research site, experimental data is stored using archive technologies that deal with each discharge as an independent set of data. These technologies (e.g. MDSplus or HDF5) are typically supplemented with a database that aggregates metadata for multiple shots to allow for efficient querying of certain predefined quantities. Often, however, a researcher will need to extract information from the archives, possibly for many shots, that is not available in the metadata store or otherwise indexed for quick retrieval. To address this need, a new search tool called TokSearch has been added to the General Atomics TokSys control design and analysis suite [1]. This tool provides the ability to rapidly perform arbitrary, parallelized queries of archived tokamak shot data (both raw and analyzed) over large numbers of shots. The TokSearch query API borrows concepts from SQL, and users can choose to implement queries in either MatlabTM or Python.

Authors:
 [1];  [1];  [1];  [1];  [1];  [1];  [1]
  1. General Atomics, San Diego, CA (United States)
Publication Date:
Research Org.:
Dept. of Energy (DOE), Washington DC (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1436502
Grant/Contract Number:
FC02-04ER54698
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Fusion Engineering and Design
Additional Journal Information:
Journal Volume: 129; Journal Issue: C; Journal ID: ISSN 0920-3796
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
70 PLASMA PHYSICS AND FUSION TECHNOLOGY; 96 KNOWLEDGE MANAGEMENT AND PRESERVATION

Citation Formats

Sammuli, Brian S., Barr, Jayson L., Eidietis, Nicholas W., Olofsson, Erik E. J., Flanagan, Sean M., Kostuk, Mark, and Humphreys, David A. TokSearch: A search engine for fusion experimental data. United States: N. p., 2018. Web. doi:10.1016/j.fusengdes.2018.02.003.
Sammuli, Brian S., Barr, Jayson L., Eidietis, Nicholas W., Olofsson, Erik E. J., Flanagan, Sean M., Kostuk, Mark, & Humphreys, David A. TokSearch: A search engine for fusion experimental data. United States. doi:10.1016/j.fusengdes.2018.02.003.
Sammuli, Brian S., Barr, Jayson L., Eidietis, Nicholas W., Olofsson, Erik E. J., Flanagan, Sean M., Kostuk, Mark, and Humphreys, David A. Sun . "TokSearch: A search engine for fusion experimental data". United States. doi:10.1016/j.fusengdes.2018.02.003.
@article{osti_1436502,
title = {TokSearch: A search engine for fusion experimental data},
author = {Sammuli, Brian S. and Barr, Jayson L. and Eidietis, Nicholas W. and Olofsson, Erik E. J. and Flanagan, Sean M. and Kostuk, Mark and Humphreys, David A.},
abstractNote = {At a typical fusion research site, experimental data is stored using archive technologies that deal with each discharge as an independent set of data. These technologies (e.g. MDSplus or HDF5) are typically supplemented with a database that aggregates metadata for multiple shots to allow for efficient querying of certain predefined quantities. Often, however, a researcher will need to extract information from the archives, possibly for many shots, that is not available in the metadata store or otherwise indexed for quick retrieval. To address this need, a new search tool called TokSearch has been added to the General Atomics TokSys control design and analysis suite [1]. This tool provides the ability to rapidly perform arbitrary, parallelized queries of archived tokamak shot data (both raw and analyzed) over large numbers of shots. The TokSearch query API borrows concepts from SQL, and users can choose to implement queries in either MatlabTM or Python.},
doi = {10.1016/j.fusengdes.2018.02.003},
journal = {Fusion Engineering and Design},
number = C,
volume = 129,
place = {United States},
year = {Sun Apr 01 00:00:00 EDT 2018},
month = {Sun Apr 01 00:00:00 EDT 2018}
}

Journal Article:
Free Publicly Available Full Text
This content will become publicly available on April 1, 2019
Publisher's Version of Record

Save / Share: