A solution of the syntactical induction-inference problem for regular languages

https://doi.org/10.1016/0096-0551(78)90006-1Get rights and content

Abstract

A Teacher knows a regular language L(G), in the form of a finite state acceptor. A method is described for selecting a set of examples, strings X, each in L(G) as inputs to the Pupil. The Set X is mapped into a lattice W (in Pupil) of finite state machines. A mapping is defined from pairs of machines in the lattice W into strings y, each of which serves as a ”crucial experiment”. The Teacher is asked to decide if the string y belongs to L(G). The process then repeats or terminates.

This procedure is shown to converge (if Teacher answers truthfully) to a finite state acceptor accepting only strings of L(G)(which obviously may be brought into canonical, minimal state form). However, this process does not depend on state minimization as an inference method.

The only necessary condition for the inference process is that every move (edge) of that finite state acceptor U(X) chosen to correspond to L(G) must be applied at least once in generating some string x in X. A proof is given that if the Teacher answers correctly, the Pupil will infer a machine behaviorally equivalent to the original acceptor U.

Elements of the lattice W are constructed by successive refinement of the partitions of the state set of the initial finite state machine U(X). Pairs are chosen in an ordered process and converted to deterministic and completely specified machines, if necessary. The two machines are tested for behavioral equivalence. If they are equivalent, one is eliminated. If not, a testing string y belonging to one machine, but not the other, is constructed and output to the teacher. If y belongs to L(G), one machine is eliminated. If not, y is tested by the Pupil against a sequence of machines generated internally. If only one machine is left, the process terminates, otherwise two new candidate machines are chosen. The algorithm described is relatively simple and easy to understand, but does not necessarily produce a minimal time solution.

References (43)

  • M. Isenman

    Program to induce a minimum state machine

  • G. Miller

    Induction

  • E.F. Moore

    Gedanken experiments on sequential machines

  • Tsyh-Wen L. Pao

    A solution of the suntactical induction-inference problem for a non-trivial subset of contest-free language

  • M. Rabin et al.

    Finite automata and their decision problems

    I.B.M. J.

    (1959)
  • F. Smith et al.

    The Genesis of Language—A Psycho-Linguistic Approach

    (1966)
  • R.J. Solomonoff

    The mechanization of linguistic learning

  • R.J. Solomonoff

    A new method for discovering the grammars of phrase structure languages

  • W. Menzel

    Theorie der Lernsysteme

    (1972)
  • W. Menzel

    An extension of the theory of learning systems

    Acta Informatica

    (1974)
  • A. Gill

    Realization of input-output relations by sequential machines

    J. Assoc. Comput. Machinery

    (1966)
  • Cited by (22)

    • Active learning for software engineering

      2019, Onward! 2019 - Proceedings of the 2019 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software, co-located with SPLASH 2019
    View all citing articles on Scopus
    View full text