07 · Acting, retrieving, and knowing the limits

Broad intuition · Study map 28 of 85

Reinforcement learning: consequences arrive later

Suggested preparation: Sampling, reasoning, and inference-time compute

Picture it

An agent chooses actions that change what happens next. A reward may arrive much later, so learning must connect consequences to earlier decisions. A value function estimates future return; a policy chooses actions.

What to understand

  • States, actions, rewards, returns, discounting, and MDPs
  • Exploration, credit assignment, and on/off-policy learning

Follow the references

  1. 1 · Course

    Hugging Face · Deep reinforcement learning course ↗

    Use Unit 1’s agent-environment loop and the first simple environment.

You understand it when…

Why can maximizing the immediate reward produce a poor long-term strategy?

This is a study map. Follow the reference for the full explanation; use the question to test your mental model. Browse the reference shelf.