Mahanaxar: quality of service guarantees in high-bandwidth, real-time streaming data storage
- Los Alamos National Laboratory
- UCSC
Large radio telescopes, cyber-security systems monitoring real-time network traffic, and others have specialized data storage needs: guaranteed capture of an ultra-high-bandwidth data stream, retention of the data long enough to determine what is 'interesting,' retention of interesting data indefinitely, and concurrent read/write access to determine what data is interesting, without interrupting the ongoing capture of incoming data. Mahanaxar addresses this problem. Mahanaxar guarantees streaming real-time data capture at (nearly) the full rate of the raw device, allows concurrent read and write access to the device on a best-effort basis without interrupting the data capture, and retains data as long as possible given the available storage. It has built in mechanisms for reliability and indexing, can scale to meet arbitrary bandwidth requirements, and handles both small and large data elements equally well. Results from our prototype implementation shows that Mahanaxar provides both better guarantees and better performance than traditional file systems.
- Research Organization:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC52-06NA25396
- OSTI ID:
- 1000950
- Report Number(s):
- LA-UR-10-02072; LA-UR-10-2072; TRN: US201101%%729
- Resource Relation:
- Conference: IEEE 2010 MSST Storage Conference ; May 3, 2010 ; Lake Tahoe, NV
- Country of Publication:
- United States
- Language:
- English
Similar Records
Virtual queueing techniques for UBR+ service in ATM with fair access and minimum bandwidth guarantee
Real-time Intrusion Detection for High-bandwidth Research Networks using Unsupervised Deep Learning