Instructor's Manual for Reinforcement Learning

An instructor's manual containing answers to all the non-programming exercises is being prepared for availability later in 1998. In the meantime, drafts are available to qualified teachers (send email to the

Readers using the book for self study can obtain answers on a chapter-by-chapter basis after working on the exercises themselves. Sends email to with your efforts to answer the exercises for a chapter, and we will send back a postscript file with the answers for that chapter.

We are also collecting overheads, code, exams, and other material useful for teaching from the book. If you have anything that may be useful in this regard that you would like to share with others, please send it in and we'll make it available here.