See the book
Sutton and Barto RL
Classification of Algorithms