skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Django Remote Submission

Abstract

The Django Remote Submission (DRS) is a Django (Django, n.d.) application to manage long running job submission, including starting the job, saving logs, and storing results. It is an independent project available as a standalone pypi package (PyPi, n.d.). It can be easily integrated in any Django project. The source code is freely available as a GitHub repository (django-remote-submission, n.d.). To run the jobs in background, DRS takes advantage of Celery (Celery, n.d.), a powerful asynchronous job queue used for running tasks in the background, and the Redis Server (Redis, n.d.), an in-memory data structure store. Celery uses brokers to pass messages between a Django Project and the Celery workers. Redis is the message broker of DRS. In addition DRS provides real time monitoring of the progress of Jobs and associated logs. Through the Django Channels project (Channels, n.d.), and the usage of Web Sockets, it is possible to asynchronously display the Job Status and the live Job output (standard output and standard error) on a web page.

Authors:
ORCiD logo [1];  [1]; ORCiD logo [1]
  1. Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Publication Date:
Research Org.:
Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1394387
Grant/Contract Number:  
AC05-00OR22725
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Journal of Open Source Software
Additional Journal Information:
Journal Volume: 2; Journal Issue: 16; Journal ID: ISSN 2475-9066
Publisher:
Open Source Initiative - NumFOCUS
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Doucet, Mathieu, Hobson, Tanner C., and Ferraz Leal, Ricardo Miguel. Django Remote Submission. United States: N. p., 2017. Web. doi:10.21105/joss.00366.
Doucet, Mathieu, Hobson, Tanner C., & Ferraz Leal, Ricardo Miguel. Django Remote Submission. United States. doi:10.21105/joss.00366.
Doucet, Mathieu, Hobson, Tanner C., and Ferraz Leal, Ricardo Miguel. Tue . "Django Remote Submission". United States. doi:10.21105/joss.00366. https://www.osti.gov/servlets/purl/1394387.
@article{osti_1394387,
title = {Django Remote Submission},
author = {Doucet, Mathieu and Hobson, Tanner C. and Ferraz Leal, Ricardo Miguel},
abstractNote = {The Django Remote Submission (DRS) is a Django (Django, n.d.) application to manage long running job submission, including starting the job, saving logs, and storing results. It is an independent project available as a standalone pypi package (PyPi, n.d.). It can be easily integrated in any Django project. The source code is freely available as a GitHub repository (django-remote-submission, n.d.). To run the jobs in background, DRS takes advantage of Celery (Celery, n.d.), a powerful asynchronous job queue used for running tasks in the background, and the Redis Server (Redis, n.d.), an in-memory data structure store. Celery uses brokers to pass messages between a Django Project and the Celery workers. Redis is the message broker of DRS. In addition DRS provides real time monitoring of the progress of Jobs and associated logs. Through the Django Channels project (Channels, n.d.), and the usage of Web Sockets, it is possible to asynchronously display the Job Status and the live Job output (standard output and standard error) on a web page.},
doi = {10.21105/joss.00366},
journal = {Journal of Open Source Software},
number = 16,
volume = 2,
place = {United States},
year = {Tue Aug 01 00:00:00 EDT 2017},
month = {Tue Aug 01 00:00:00 EDT 2017}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Save / Share: