On the applications of multiplicity automata in learning
- Technion, Haifa (Israel)
- Univ. of Calgary, Alberta (Canada); and others
Recently the learnability of multiplicity automata attracted a lot of attention, mainly because of its implications on the learnability of several classes of DNF formulae. In this paper we further study the learnability of multiplicity automata. Our starting point is a known theorem from automata theory relating the number of states in a minimal multiplicity automaton for a function f to the rank of a certain matrix F. With this theorem in hand we obtain the following results: (1) A new simple algorithm for learning multiplicity automata in the spirit with a better query complexity. As a result, we improve the complexity for all classes that use the algorithms of and also obtain the best query complexity for several classes known to be learnable by other methods such as decision trees and polynomials over GF(2). (2) We prove the learnability of some new classes that were not known to be learnable before. Most notably, the class of polynomials over finite fields, the class of bounded-degree polynomials over infinite fields, the class of XOR of terms, and a certain class of decision-trees. (3) While multiplicity automata were shown to be useful to prove the learnability of some subclasses of DNF formulae and various other classes, we study the limitations of this method. We prove that this method cannot be used to resolve the learnability of some other open problems such as the learnability of general DNF formulae or even k -term DNF for k = {omega}(log n) or satisfy-s DNF formulae for s = {omega}(1). These results are proven by exhibiting functions in the above classes that require multiplicity automata with superpolynomial number of states.
- OSTI ID:
- 457666
- Report Number(s):
- CONF-961004-; TRN: 97:001036-0037
- Resource Relation:
- Conference: 37. annual symposium on foundations of computer science, Burlington, VT (United States), 13-16 Oct 1996; Other Information: PBD: 1996; Related Information: Is Part Of Proceedings of the 37th annual symposium on foundations of computer science; PB: 656 p.
- Country of Publication:
- United States
- Language:
- English
Similar Records
Lower bounds on parallel, distributed, and automata computations
Determinization of logical specifications of automata