1. Neuroscience
Download icon

The modulation of savouring by prediction error and its effects on choice

  1. Kiyohito Iigaya  Is a corresponding author
  2. Giles W Story
  3. Zeb Kurth-Nelson
  4. Raymond J Dolan
  5. Peter Dayan
  1. University College London, United Kingdom
Research Article
  • Cited 42
  • Annotations
Cite this article as: eLife 2016;5:e13747 doi: 10.7554/eLife.13747

Abstract

When people anticipate uncertain future outcomes, they often prefer to know their fate in advance. Inspired by an idea in behavioral economics that the anticipation of rewards is itself attractive, we hypothesized that this preference of advance information arises because reward prediction errors carried by such information can boost the level of anticipation. We designed new empirical behavioral studies to test this proposal, and confirmed that subjects preferred advance reward information more strongly when they had to wait for rewards for a longer time. We formulated our proposal in a reinforcement-learning model, and we showed that our model accounts for a wide range of existing neuronal and behavioral data, without appealing to ambiguous notions such as an explicit value for information. We suggest that such boosted anticipation significantly drives risk-seeking behaviors, most pertinently in gambling.

Article and author information

Author details

  1. Kiyohito Iigaya

    Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom
    For correspondence
    kiigaya@gatsby.ucl.ac.uk
    Competing interests
    The authors declare that no competing interests exist.
  2. Giles W Story

    The Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  3. Zeb Kurth-Nelson

    The Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  4. Raymond J Dolan

    The Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
  5. Peter Dayan

    Gatsby Computational Neuroscience Unit, University College London, London, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.

Ethics

Human subjects: Human subjects: All participants provided written informed consent and consent to publish prior to start of the experiment, which was approved by the Research Ethics Committee at University College London (UCL Research Ethics Reference: 3450/002)

Reviewing Editor

  1. Naoshige Uchida, Harvard University, United States

Publication history

  1. Received: December 13, 2015
  2. Accepted: April 14, 2016
  3. Accepted Manuscript published: April 21, 2016 (version 1)
  4. Version of Record published: May 13, 2016 (version 2)

Copyright

© 2016, Iigaya et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 42
    Citations

Article citation count generated by polling the highest count across the following sources: Scopus, Crossref, PubMed Central.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Download citations (links to download the citations from this article in formats compatible with various reference manager tools)

Open citations (links to open the citations from this article in various online reference manager services)

Further reading

    1. Neuroscience
    Anastassios Karagiannis et al.
    Research Article Updated

    Glucose is the mandatory fuel for the brain, yet the relative contribution of glucose and lactate for neuronal energy metabolism is unclear. We found that increased lactate, but not glucose concentration, enhances the spiking activity of neurons of the cerebral cortex. Enhanced spiking was dependent on ATP-sensitive potassium (KATP) channels formed with KCNJ11 and ABCC8 subunits, which we show are functionally expressed in most neocortical neuronal types. We also demonstrate the ability of cortical neurons to take-up and metabolize lactate. We further reveal that ATP is produced by cortical neurons largely via oxidative phosphorylation and only modestly by glycolysis. Our data demonstrate that in active neurons, lactate is preferred to glucose as an energy substrate, and that lactate metabolism shapes neuronal activity in the neocortex through KATP channels. Our results highlight the importance of metabolic crosstalk between neurons and astrocytes for brain function.

    1. Neuroscience
    Riccardo Caramellino et al.
    Research Advance

    Efficient processing of sensory data requires adapting the neuronal encoding strategy to the statistics of natural stimuli. Previously, in Hermundstad et al., 2014, we showed that local multipoint correlation patterns that are most variable in natural images are also the most perceptually salient for human observers, in a way that is compatible with the efficient coding principle. Understanding the neuronal mechanisms underlying such adaptation to image statistics will require performing invasive experiments that are impossible in humans. Therefore, it is important to understand whether a similar phenomenon can be detected in animal species that allow for powerful experimental manipulations, such as rodents. Here we selected four image statistics (from single- to four-point correlations) and trained four groups of rats to discriminate between white noise patterns and binary textures containing variable intensity levels of one of such statistics. We interpreted the resulting psychometric data with an ideal observer model, finding a sharp decrease in sensitivity from two- to four-point correlations and a further decrease from four- to three-point. This ranking fully reproduces the trend we previously observed in humans, thus extending a direct demonstration of efficient coding to a species where neuronal and developmental processes can be interrogated and causally manipulated.