Reinforcement Learning: An Introduction

Small book cover

Richard S. Sutton
and Andrew G. Barto

Second Edition (see here for the first edition)
MIT Press, Cambridge, MA, 2018

Buy from Amazon
Full Pdf pdf without margins (good for ipad)
New Code
Old Code
Solutions -- send in your solutions for a chapter, get the official ones back (currently incomplete)
Teaching Aids
Literature sources cited in the book
Latex Notation -- Want to use the book's notation in your own work? Download this .sty file and this example of its use

Help out!

If you enjoyed the book, why not give back to the community?

I am collecting a public directory with pdf files of the original sources cited in the book. I have had to close this directory because of too much accidental damage, so if you collect any additonal pdf files, please send them to (at and i will add them to the public directory (please follow the existing naming convention). I'd like to have all the book's references and to link to them directly from the book's pdf file.