The strobe algorithms for multi-source warehouse consistency
A warehouse is a data repository containing integrated information for efficient querying and analysis. Maintaining the consistency of warehouse data is challenging, especially if the data sources are autonomous and views of the data at the warehouse span multiple sources. Transactions containing multiple updates at one or more sources, e.g., batch updates, complicate the consistency problem. In this paper we identify and discuss three fundamental transaction processing scenarios for data warehousing. We define four levels of consistency for warehouse data and present a new family of algorithms, the Strobe family, that maintain consistency as the warehouse is updated, under the various warehousing scenarios. All of the algorithms are incremental and can handle a continuous and overlapping stream of updates from the sources. Our implementation shows that the algorithms are practical and realistic choices for a wide variety of update scenarios.
- Publication Date:
- OSTI Identifier:
- Report Number(s):
CNN: Contract F30602-C-0237; TRN: 97:003191-0012
- Resource Type:
- Resource Relation:
- Conference: 4. international conference on parallel and distributed information systems, Miami Beach, FL (United States), 18-20 Dec 1996; Other Information: PBD: 1996; Related Information: Is Part Of Proceedings of the fourth international conference on parallel and distributed information systems; PB: 307 p.
- IEEE Computer Society Press, Los Alamitos, CA (United States)
- Country of Publication:
- United States
- 99 MATHEMATICS, COMPUTERS, INFORMATION SCIENCE, MANAGEMENT, LAW, MISCELLANEOUS; DATA BASE MANAGEMENT; ALGORITHMS; MAINTENANCE; INFORMATION RETRIEVAL