Abstract

GARCIA-HERNANDEZ, Ma. de G. et al. Acceleration of association-rule based markov decision processes. J. appl. res. technol [online]. 2009, vol.7, n.3, pp.354-373. ISSN 2448-6736.

In this paper, we present a new approach for the estimation of Markov decision processes based on efficient association rule mining techniques such as Apriori. For the fastest solution of the resulting association-rule based Markov decision process, several accelerating procedures such as asynchronous updates and prioritization using a static ordering have been applied. A new criterion for state reordering in decreasing order of maximum reward is also compared with a modified topological reordering algorithm. Experimental results obtained on a finite state and action-space stochastic shortest path problem demonstrate the feasibility of the new approach.

Keywords : Markov decision processes; association rules; acceleration procedures.

        · abstract in Spanish     · text in English     · English ( pdf )