---

Next: 7 Eligibility Traces

---

---

• 7 Eligibility Traces
  • 7.1 n-step TD Prediction
  • 7.2 The Forward View of TD()
  • 7.3 The Backward View of TD()
  • 7.4 Equivalence of the Forward and Backward Views
  • 7.5 Sarsa()
  • 7.6 Q()
  • 7.7 Eligibility Traces for Actor-Critic Methods (*)
  • 7.8 Replacing Traces
  • 7.9 Implementation Issues
  • 7.10 Variable (*)
  • 7.11 Conclusions
  • 7.12 Bibliographical and Historical Remarks
• About this document ...

---

Richard Sutton
Fri May 30 15:01:47 EDT 1997