CLARA: A Contemporary Approach to Physics Data Processing
In traditional physics data processing (PDP) systems, data location is static and is accessed by analysis applications. In comparison, CLARA (CLAS12 Reconstruction and Analysis framework) is an environment where data processing algorithms filter continuously flowing data. In CLARA's domain of loosely coupled services, data is not stored, but rather flows from one service to another, mutating constantly along the way. Agents, performing event processing, can then subscribe to particular data/events at any stage of the data transformation, and make intricate decisions (e.g. particle ID) by correlating events from multiple, parallel data streams and/or services. This paper presents a PDP application development framework based on service oriented and event driven architectures. This system allows users to design (Java, C++, and Python languages are supported) and deploy data processing services, as well as dynamically compose PDP applications using available services. The PDP service bus provides a layer on top of a distributed pub-sub middleware implementation, which allows complex service composition and integration without writing code. Examples of service creation and deployment, along with the CLAS12 track reconstruction application design will be presented.
- Research Organization:
- Thomas Jefferson National Accelerator Facility (TJNAF), Newport News, VA (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC)
- DOE Contract Number:
- AC05-06OR23177
- OSTI ID:
- 1038749
- Report Number(s):
- JLAB-PHY-10-1302; DOE/OR/23177-1400; TRN: US201208%%816
- Journal Information:
- J.Phys.Conf.Ser., Vol. 331; Conference: CHEP 2010, Taipei, Taiwan, 8-22 October 2010
- Country of Publication:
- United States
- Language:
- English
Similar Records
Component based dataflow processing framework
Heterogeneous data-processing optimization with CLARA’s adaptive workflow orchestrator