Bartók, Gábor and Szepesvári, Csaba and Zilles, S. (2010) Models of active learning in group-structured state spaces. Information and Computation, 208. pp. 364-384.

Full text not available from this repository.

Abstract

We investigate the problem of learning the transition dynamics of deterministic, discrete- state environments. We assume that an agent exploring such an environment is able to perform actions (from a finite set of actions) in the environment and to sense the state changes. The question investigated is whether the agent can learn the dynamics without visiting all states. Such a goal is unrealistic in general, hence we assume that the environ- ment has structural properties an agent might exploit. In particular, we assume that the set of all action sequences forms an algebraic group. We introduce a learning model in different variants and study under which circum- stances the corresponding “group-structured environments” can be learned efficiently by experimenting with group generators (actions). It turns out that for some classes of such environments the choice of actions given to the agent determines if efficient learning is possible. Negative results are presented, even without efficiency constraints, for rather general classes of groups, showing that even with group structure, learning an environment from partial information is far from trivial. However, positive results for special subclasses of Abelian groups turn out to be a good starting point for the design of efficient learning algorithms based on structured representations.

Item Type:	ISI Article
Subjects:	Q Science > QA Mathematics and Computer Science > QA75 Electronic computers. Computer science / számítástechnika, számítógéptudomány
Depositing User:	Eszter Nagy
Date Deposited:	11 Dec 2012 16:04
Last Modified:	11 Dec 2012 16:04
URI:	https://eprints.sztaki.hu/id/eprint/5839

Update Item