Code for:

Reinforcement Learning: An Introduction, 2nd edition
by Richard S. Sutton and Andrew G. Barto

Below are links to a variety of software related to examples and exercises in the book.
And below is some of the code that Rich used to generate the examples and figures in the 2nd edition (made available as is):