Categories

Archive

99 022

Optimal Classifier System Performance in Non-Markov Environments

Lanzi, P.L., Wilson, S.W. (1999)
TR No.: 99022 | Download PDF | Download PS

Abstract:

Wilson’s (1994) bit-register memory scheme was incorporated into the XCS classifier system and investigated in a series of non-Markov environments. Two extensions to the scheme proved important for reaching optimal performance in the harder environments. The first was an exploration strategy in which exploration of external actions was probabilistic as in Markov environments, but internal “actions” (register settings) were selected deterministically. The second was use of a register having more bit-positions than were strictly necessary to resolve environmental aliasing. The origins and effects of the two extensions are discussed.

Write a comment