Software Architecture Challenges for Data Intensive Computing

Conference · Thu Feb 21 23:00:00 EST 2008

DOI:https://doi.org/10.1109/WICSA.2008.50· OSTI ID:925717

Gorton, Ian

Data intensive computing is concerned with creating scalable solutions for capturing, analyzing, managing and understanding multi-terabyte and petabyte data volumes. Such data volumes exist in a diverse range of application domains, including scientific research, bio-informatics, cyber security, social computing and commerce. Innovative hardware and software technologies to address these problems must scale to meet these ballooning data volumes and simultaneously reduce the time needed to provide effective data analysis. This paper describes some of the software architecture challenges that must be addressed when building data intensive applications and supporting infrastructures. These revolve around requirements for adaptive resource utilization and management, flexible integration, robustness and scalable data management.

• Research Organization: Pacific Northwest National Laboratory (PNNL), Richland, WA (US)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC05-76RL01830
• OSTI ID: 925717
• Report Number(s): PNNL-SA-59642
• Country of Publication: United States
• Language: English

Related Subjects

99 GENERAL AND MISCELLANEOUS
COMPUTER ARCHITECTURE
DATA ANALYSIS
DATA BASE MANAGEMENT
SECURITY
data intensive computing
software architecture