Wolfram Schultz
German neuroscientist (Cambridge), known for foundational work on the dopamine reward system. His research showed that dopamine neurons don’t fire on receiving a reward — they fire on the prediction error between expected and actual reward.
Key finding
- Dopamine encodes reward prediction error, not reward magnitude. Neurons fire in proportion to the delta between predicted and actual reward: better-than-expected → burst, as-expected → no change, worse-than-expected → dip. This is the operative principle behind both Schultz’s primate experiments and most of modern reinforcement-learning theory.
- Dopamine peaks during anticipation, not receipt, of uncertain rewards. Anticipatory dopamine migrates backward in time onto cues that reliably predict reward, which is why a notification icon can itself produce dopamine before any reward is delivered.
Why he matters here
Schultz’s work explains why Variable ratio reinforcement is so effective in Loot boxes and gacha pulls: the dopamine high happens during the pull animation, not when the prize is revealed. This is why loot box openings are theatrical and slow — they are stretching out the dopamine peak. The reveal itself is often anticlimactic, which is precisely why players keep pulling.
This also underpins the Near miss effect — a near-win produces a dopamine response similar to an actual win, fueling the next attempt.
Sources
- Mobile Game Monetization Psychology (video)
- The neuroscience of rewards - how dopamine builds game addiction (video) — extends the RPE story into operational mobile-game design (cues, habit-vs-surprise, FOMO distinction)
- Why Streaks Work (It’s Not Discipline) (video) — names Schultz directly; the coffee-smell / notification-chime pop framing of anticipatory dopamine, applied to the streak number as a cue that triggers the Habit loop before the app opens