br.unicamp.cst.learning

Class SimpleRLearn

java.lang.Object

br.unicamp.cst.learning.SimpleRLearn

public class SimpleRLearn
extends java.lang.Object

This class is used to perform a simple reinforcement learning. It is composed by a Q table with rows meaning states and columns meaning actions. For row s and column a, we have: Q(s,a) = Q(s,a) + R Where R is the reward for performing action a at state s. Important: This method does not account for state transitions like Q-Learning or SARSA do.

Constructor Summary

Constructors

Constructor and Description
SimpleRLearn(int Ns, int Na) Default Constructor.

Method Summary

Modifier and Type	Method and Description
void	addAction() Add action.
void	addState() Add state.
int	getBestAction(int s) Gets the best action for state s.
int	getNa() Gets NA value.
int	getNs() Gets NS value.
double[][]	getQ() Gets Q value.
boolean	isEmpty() Verify if is empty.
void	printQ() Print Q value.
void	setNa(int na) Sets NA value.
void	setNs(int ns) Gets NS value.
void	setQ(double[][] q) Sets Q value.
void	update(int s, int a, double r) Updates Q table of values.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleRLearn

public SimpleRLearn(int Ns,
                    int Na)

Default Constructor.

Parameters:

Ns -

Na -

Method Detail

update

public void update(int s,
                   int a,
                   double r)

Updates Q table of values.

Parameters:

s - current state

a - chosen action

r - reward for performing action a in state s, should be between -1 and 1

addAction

public void addAction()

Add action.

addState

public void addState()

Add state.

printQ

public void printQ()

Print Q value.

getBestAction

public int getBestAction(int s)

Gets the best action for state s. If there is a tie between best actions, it chooses randomly between them.

Parameters:

s - input state

Returns:

best action for state s

getQ

public double[][] getQ()

Gets Q value.

Returns:

the q

setQ

public void setQ(double[][] q)

Sets Q value.

Parameters:

q - the q to set

getNa

public int getNa()

Gets NA value.

Returns:

the na

setNa

public void setNa(int na)

Sets NA value.

Parameters:

na - the na to set

getNs

public int getNs()

Gets NS value.

Returns:

the ns

setNs

public void setNs(int ns)

Gets NS value.

Parameters:

ns - the ns to set

isEmpty

public boolean isEmpty()

Verify if is empty.

Returns:

true or false