FireHose Streaming Benchmarks

RESOURCE

Abstract

The FireHose Streaming Benchmarks are a suite of stream-processing benchmarks defined to enable comparison of streaming software and hardware, both quantitatively vis-a-vis the rate at which they can process data, and qualitatively by judging the effort involved to implement and run the benchmarks. Each benchmark has two parts. The first is a generator which produces and outputs datums at a high rate in a specific format. The second is an analytic which reads the stream of datums and is required to perform a well-defined calculation on the collection of datums, typically to find anomalous datums that have been created in the stream by the generator. The FireHose suite provides code for the generators, sample code for the analytics (which users are free to re-implement in their own custom frameworks), and a precise definition of each benchmark calculation.
Developers:
Plimpton, Steve Anderson, Karl [1]
  1. DOD
Release Date:
2015-01-26
Project Type:
Open Source, Publicly Available Repository
Software Type:
Scientific
Programming Languages:
C++
Shell
C
Makefile
Python
Licenses:
BSD 3-clause "New" or "Revised" License
Sponsoring Org.:
Code ID:
3258
Site Accession Number:
SCR# 1715.0
Research Org.:
Sandia National Laboratory
Country of Origin:
United States

RESOURCE

Citation Formats

Plimpton, Steve, and Anderson, Karl. FireHose Streaming Benchmarks. Computer Software. https://github.com/sandialabs/firehose. USDOE. 26 Jan. 2015. Web. doi:10.11578/dc.20171025.1584.
Plimpton, Steve, & Anderson, Karl. (2015, January 26). FireHose Streaming Benchmarks. [Computer software]. https://github.com/sandialabs/firehose. https://doi.org/10.11578/dc.20171025.1584.
Plimpton, Steve, and Anderson, Karl. "FireHose Streaming Benchmarks." Computer software. January 26, 2015. https://github.com/sandialabs/firehose. https://doi.org/10.11578/dc.20171025.1584.
@misc{ doecode_3258,
title = {FireHose Streaming Benchmarks},
author = {Plimpton, Steve and Anderson, Karl},
abstractNote = {The FireHose Streaming Benchmarks are a suite of stream-processing benchmarks defined to enable comparison of streaming software and hardware, both quantitatively vis-a-vis the rate at which they can process data, and qualitatively by judging the effort involved to implement and run the benchmarks. Each benchmark has two parts. The first is a generator which produces and outputs datums at a high rate in a specific format. The second is an analytic which reads the stream of datums and is required to perform a well-defined calculation on the collection of datums, typically to find anomalous datums that have been created in the stream by the generator. The FireHose suite provides code for the generators, sample code for the analytics (which users are free to re-implement in their own custom frameworks), and a precise definition of each benchmark calculation.},
doi = {10.11578/dc.20171025.1584},
url = {https://doi.org/10.11578/dc.20171025.1584},
howpublished = {[Computer Software] \url{https://doi.org/10.11578/dc.20171025.1584}},
year = {2015},
month = {jan}
}