skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The strobe algorithms for multi-source warehouse consistency

Abstract

A warehouse is a data repository containing integrated information for efficient querying and analysis. Maintaining the consistency of warehouse data is challenging, especially if the data sources are autonomous and views of the data at the warehouse span multiple sources. Transactions containing multiple updates at one or more sources, e.g., batch updates, complicate the consistency problem. In this paper we identify and discuss three fundamental transaction processing scenarios for data warehousing. We define four levels of consistency for warehouse data and present a new family of algorithms, the Strobe family, that maintain consistency as the warehouse is updated, under the various warehousing scenarios. All of the algorithms are incremental and can handle a continuous and overlapping stream of updates from the sources. Our implementation shows that the algorithms are practical and realistic choices for a wide variety of update scenarios.

Authors:
; ;  [1]
  1. Stanford Univ., CA (United States)
Publication Date:
OSTI Identifier:
535549
Report Number(s):
CONF-961209-
CNN: Contract F30602-C-0237; TRN: 97:003191-0012
Resource Type:
Conference
Resource Relation:
Conference: 4. international conference on parallel and distributed information systems, Miami Beach, FL (United States), 18-20 Dec 1996; Other Information: PBD: 1996; Related Information: Is Part Of Proceedings of the fourth international conference on parallel and distributed information systems; PB: 307 p.
Country of Publication:
United States
Language:
English
Subject:
99 MATHEMATICS, COMPUTERS, INFORMATION SCIENCE, MANAGEMENT, LAW, MISCELLANEOUS; DATA BASE MANAGEMENT; ALGORITHMS; MAINTENANCE; INFORMATION RETRIEVAL

Citation Formats

Zhuge, Yue, Garcia-Molina, H., and Wiener, J.L. The strobe algorithms for multi-source warehouse consistency. United States: N. p., 1996. Web.
Zhuge, Yue, Garcia-Molina, H., & Wiener, J.L. The strobe algorithms for multi-source warehouse consistency. United States.
Zhuge, Yue, Garcia-Molina, H., and Wiener, J.L. 1996. "The strobe algorithms for multi-source warehouse consistency". United States. doi:.
@article{osti_535549,
title = {The strobe algorithms for multi-source warehouse consistency},
author = {Zhuge, Yue and Garcia-Molina, H. and Wiener, J.L.},
abstractNote = {A warehouse is a data repository containing integrated information for efficient querying and analysis. Maintaining the consistency of warehouse data is challenging, especially if the data sources are autonomous and views of the data at the warehouse span multiple sources. Transactions containing multiple updates at one or more sources, e.g., batch updates, complicate the consistency problem. In this paper we identify and discuss three fundamental transaction processing scenarios for data warehousing. We define four levels of consistency for warehouse data and present a new family of algorithms, the Strobe family, that maintain consistency as the warehouse is updated, under the various warehousing scenarios. All of the algorithms are incremental and can handle a continuous and overlapping stream of updates from the sources. Our implementation shows that the algorithms are practical and realistic choices for a wide variety of update scenarios.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = 1996,
month =
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share:
  • We apply optimization and tabu search to a minimum cost inventory problem with deterministic or stochastic demand functions. We present new algorithm which use tabu search and show encouraging promise results. Applications and computational results are presented.
  • A Multi-blocked variant to the LU decomposition algorithm is considered. The algorithm differs from traditional blocked methods in that it is amenable to pivoting both on the matrix and block levels. The technique is applied to both dense and banded matrices.
  • We present two algorithms for determining sensor motion of a multi-spectral push-broom imager for use in subsequent image registration. The first algorithm, termed the {open_quotes}pairwise{close_quotes} method, performs cross-correlations between individual pairs of channels. The offsets of maximum correlation are formulated into a system of linear equations whose solution gives an estimate of the jitter function. The second algorithm performs cross-correlations between channels and a reference image called the {open_quotes}baseline{close_quotes} which is constructed by averaging together all the channels in the image cube. An estimated jitter time series is computed for each channel, all of which are overlapped and averaged tomore » obtain a best estimate of the jitter function. The pairwise method is more general in that it can handle a wider range of jitter scenarios. The baseline method, although more restricted, is very simple to implement, and its accuracy can be improved substantially through iteration. In this paper, we describe both methods in detail and present results of simulations performed on thermal-infrared data cubes.« less
  • Deriving information about the Earth's surface requires atmospheric corrections of the measured top-of-the-atmosphere radiances. One possible path is to use atmospheric radiative transfer codes to predict how the radiance leaving the ground is affected by the scattering and attenuation. In practice the atmosphere is usually not well known and thus it is necessary to use more practical methods. The authors will describe how to find dark surfaces, estimate the atmospheric optical depth, estimate path radiance and identify thick clouds using thresholds on reflectance and NDVI and columnar water vapor. The authors describe a simple method to correct a visible channelmore » contaminated by a thin cirrus clouds.« less