Abstract
The DeepLynx Airflow Provider Package is a python package used to interact with the data warehouse DeepLynx when using the workflow orchestration tool Apache Airflow. This python package is packaged together using the airflow package standard so that it can be easily installed and used in any Apache Airflow environment. This package is meant to encapsulate the DeepLynx API for use in Airflow so that any interactions with DeepLynx that a user may want to use in their Airflow workflow can be easily accomplished using this provider package. This allows us to develop, implement, and test our DeepLynx-Airflow interactions in one provider package repository, and then easily install and use this package in any airflow instance. This DeepLynx Airflow Provider Package will be used extensively by the DeepLynx DAG repository.
- Developers:
-
Cavaluzzi, Jack [1] ; Brownlee, Jaren [1] ;
.png "ORCID")
[1]
;
[1]
;
Zohner, Porter
[1]
;
Hergesheimer, Natalie
[1]
;
Swinford, Jake
[1]
- Idaho National Laboratory (INL), Idaho Falls, ID (United States)
- Release Date:
- 2024-06-13
- Project Type:
- Open Source, Publicly Available Repository
- Software Type:
- Scientific
- Programming Languages:
-
Python
- Licenses:
-
MIT License
- Sponsoring Org.:
-
USDOE Office of Nuclear Energy (NE)Primary Award/Contract Number:AC07-05ID14517
- Code ID:
- 137078
- Research Org.:
- Idaho National Laboratory (INL), Idaho Falls, ID (United States)
- Country of Origin:
- United States
- Keywords:
- DeepLynx Digital Twin Workflow ETL Extract Transform Load Digital Engineering Digital Thread Airflow
Citation Formats
Cavaluzzi, Jack M., Brownlee, Jaren M., Browning, Jeren M., Houck, Edward K., Zohner, Porter J., Hergesheimer, Natalie A., and Swinford, Jake O.
Deeplynx Airflow Provider Package.
Computer Software.
https://github.com/idaholab/airflow-provider-deeplynx.
USDOE Office of Nuclear Energy (NE).
13 Jun. 2024.
Web.
doi:10.11578/dc.20240722.1.
Cavaluzzi, Jack M., Brownlee, Jaren M., Browning, Jeren M., Houck, Edward K., Zohner, Porter J., Hergesheimer, Natalie A., & Swinford, Jake O.
(2024, June 13).
Deeplynx Airflow Provider Package.
[Computer software].
https://github.com/idaholab/airflow-provider-deeplynx.
https://doi.org/10.11578/dc.20240722.1.
Cavaluzzi, Jack M., Brownlee, Jaren M., Browning, Jeren M., Houck, Edward K., Zohner, Porter J., Hergesheimer, Natalie A., and Swinford, Jake O.
"Deeplynx Airflow Provider Package." Computer software.
June 13, 2024.
https://github.com/idaholab/airflow-provider-deeplynx.
https://doi.org/10.11578/dc.20240722.1.
@misc{
doecode_137078,
title = {Deeplynx Airflow Provider Package},
author = {Cavaluzzi, Jack M. and Brownlee, Jaren M. and Browning, Jeren M. and Houck, Edward K. and Zohner, Porter J. and Hergesheimer, Natalie A. and Swinford, Jake O.},
abstractNote = {The DeepLynx Airflow Provider Package is a python package used to interact with the data warehouse DeepLynx when using the workflow orchestration tool Apache Airflow. This python package is packaged together using the airflow package standard so that it can be easily installed and used in any Apache Airflow environment. This package is meant to encapsulate the DeepLynx API for use in Airflow so that any interactions with DeepLynx that a user may want to use in their Airflow workflow can be easily accomplished using this provider package. This allows us to develop, implement, and test our DeepLynx-Airflow interactions in one provider package repository, and then easily install and use this package in any airflow instance. This DeepLynx Airflow Provider Package will be used extensively by the DeepLynx DAG repository.},
doi = {10.11578/dc.20240722.1},
url = {https://doi.org/10.11578/dc.20240722.1},
howpublished = {[Computer Software] \url{https://doi.org/10.11578/dc.20240722.1}},
year = {2024},
month = {jun}
}