The modulation of savouring by prediction error and its effects on choice

  1. Kiyohito Iigaya  Is a corresponding author
  2. Giles W Story
  3. Zeb Kurth-Nelson
  4. Raymond J Dolan
  5. Peter Dayan
  1. University College London, United Kingdom

Abstract

When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors carried by such information can boost the level of anticipation. We designed new empirical behavioral studies to test this proposal, and confirmed that subjects preferred advance reward information more strongly when they had to wait for rewards for a longer time. We formulated our proposal in a reinforcement-learning model, and we showed that our model accounts for a wide range of existing neuronal and behavioral data, without appealing to ambiguous notions such as an explicit value for information. We suggest that such boosted anticipation significantly drives risk-seeking behaviors, most pertinently in gambling.

Article and author information

Author details

  1. Kiyohito Iigaya

    Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom
    For correspondence
    kiigaya@gatsby.ucl.ac.uk
    Competing interests
    The authors declare that no competing interests exist.
  2. Giles W Story

    The Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  3. Zeb Kurth-Nelson

    The Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  4. Raymond J Dolan

    The Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  5. Peter Dayan

    Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.

Ethics

Human subjects: Human subjects: All participants provided written informed consent and consent to publish prior to start of the experiment, which was approved by the Research Ethics Committee at University College London (UCL Research Ethics Reference: 3450/002)

Copyright

© 2016, Iigaya et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 3,296
    views
  • 640
    downloads
  • 80
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Kiyohito Iigaya
  2. Giles W Story
  3. Zeb Kurth-Nelson
  4. Raymond J Dolan
  5. Peter Dayan
(2016)
The modulation of savouring by prediction error and its effects on choice
eLife 5:e13747.
https://doi.org/10.7554/eLife.13747

Share this article

https://doi.org/10.7554/eLife.13747

Further reading

    1. Neuroscience
    Lisa M Bas, Ian D Roberts ... Anita Tusche
    Research Article

    People selectively help others based on perceptions of their merit or need. Here, we develop a neurocomputational account of how these social perceptions translate into social choice. Using a novel fMRI social perception task, we show that both merit and need perceptions recruited the brain’s social inference network. A behavioral computational model identified two non-exclusive mechanisms underlying variance in social perceptions: a consistent tendency to perceive others as meritorious/needy (bias) and a propensity to sample and integrate normative evidence distinguishing high from low merit/need in other people (sensitivity). Variance in people’s merit (but not need) bias and sensitivity independently predicted distinct aspects of altruism in a social choice task completed months later. An individual’s merit bias predicted context-independent variance in people’s overall other-regard during altruistic choice, biasing people toward prosocial actions. An individual’s merit sensitivity predicted context-sensitive discrimination in generosity toward high and low merit recipients by influencing other- and self-regard during altruistic decision-making. This context-sensitive perception–action link was associated with activation in the right temporoparietal junction. Together, these findings point toward stable, biologically based individual differences in perceptual processes related to abstract social concepts like merit, and suggest that these differences may have important behavioral implications for an individual’s tendency toward favoritism or discrimination in social settings.

    1. Neuroscience
    Weihua Cai, Arkady Khoutorsky
    Insight

    Mice lacking two neuropeptides thought to be essential for processing pain show no change in how they respond to a wide range of harmful stimuli.