Representing and computing regular languages on massively parallel networks
- Electronic Systems and Research Lab., of Electrical Engineering, Washington Univ., St. Louis, MO (US)
- Dept. of Electrical, Computer and Systems Engineering, Rensselaer Polytechnic Inst., Troy, NY (US)
- Dept. of Electrical Engineering, Southern Illinois Univ., Edwardsville, IL (US)
This paper proposes a general method for incorporating rule-based constraints corresponding to regular languages into stochastic inference problems, thereby allowing for a unified representation of stochastic and syntactic pattern constraints. The authors' approach first established the formal connection of rules to Chomsky grammars, and generalizes the original work of Shannon on the encoding of rule-based channel sequences to Markov chains of maximum entropy. This maximum entropy probabilistic view leads to Gibb's representations with potentials which have their number of minima growing at precisely the exponential rate that the language of deterministically constrained sequences grow. These representations are coupled to stochastic diffusion algorithms, which sample the language-constrained sequences by visiting the energy minima according to the underlying Gibbs' probability law. The coupling to stochastic search methods yields the all-important practical result that fully parallel stochastic cellular automata may be derived to generate samples from the rule-based constraint sets. The production rules and neighborhood state structure of the language of sequences directly determines the necessary connection structures of the required parallel computing surface. Representations of this type have been mapped to the DAP-510 massively-parallel processor consisting of 1024 mesh-connected bit-serial processing elements for performing automated segmentation of electron-micrograph images.
- Sponsoring Organization:
- National Science Foundation (NSF); National Science Foundation, Washington, DC (United States)
- OSTI ID:
- 6253747
- Journal Information:
- IEEE Transactions on Neural Networks (Institute of Electrical and Electronics Engineers); (United States), Vol. 2:1; ISSN 1045-9227
- Country of Publication:
- United States
- Language:
- English
Similar Records
Formalization of operations and function definitions in a functional programming language for data structure
Semantics for coordinated substitution grammars as implemented in Prolog