Orbitofrontal neurons acquire responses to 'valueless' Pavlovian cues during unblocking

  1. Michael A McDannald
  2. Guillem R Esber
  3. Meredyth A Wegener
  4. Heather M Wied
  5. Tzu-Lan Liu
  6. Thomas A Stalnaker
  7. Joshua L Jones
  8. Jason Trageser
  9. Geoffrey Schoenbaum  Is a corresponding author
  1. National Institute on Drug Abuse, United States
  2. University of Pittsburg, United States
  3. University of Maryland School of Medicine, United States
  4. National Taiwan University, Taiwan
  5. Johns Hopkins University, United States

Abstract

The orbitofrontal cortex (OFC) has been described as signaling outcome expectancies or value. Evidence for the latter comes from the studies showing that neural signals in the OFC correlate with value across features. Yet features can co-vary with value, and individual units may participate in multiple ensembles coding different features. Here we used unblocking to test whether OFC neurons would respond to a predictive cue signaling a 'valueless' change in outcome flavor. Neurons were recorded as the rats learned about cues that signaled either an increase in reward number or a valueless change in flavor. We found that OFC neurons acquired responses to both predictive cues. This activity exceeded that exhibited to a 'blocked' cue and was correlated with activity to the actual outcome. These results show that OFC neurons fire to cues with no value independent of what can be inferred through features of the predicted outcome.

Article and author information

Author details

  1. Michael A McDannald

    National Institute on Drug Abuse, Baltimore, United States
    Competing interests
    The authors declare that no competing interests exist.
  2. Guillem R Esber

    National Institute on Drug Abuse, Baltimore, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. Meredyth A Wegener

    University of Pittsburg, Pittsburg, United States
    Competing interests
    The authors declare that no competing interests exist.
  4. Heather M Wied

    University of Maryland School of Medicine, Baltimore, United States
    Competing interests
    The authors declare that no competing interests exist.
  5. Tzu-Lan Liu

    National Taiwan University, Taipei, Taiwan
    Competing interests
    The authors declare that no competing interests exist.
  6. Thomas A Stalnaker

    National Institute on Drug Abuse, Baltimore, United States
    Competing interests
    The authors declare that no competing interests exist.
  7. Joshua L Jones

    University of Maryland School of Medicine, Baltimore, United States
    Competing interests
    The authors declare that no competing interests exist.
  8. Jason Trageser

    Johns Hopkins University, Baltimore, United States
    Competing interests
    The authors declare that no competing interests exist.
  9. Geoffrey Schoenbaum

    National Institute on Drug Abuse, Baltimore, United States
    For correspondence
    geoffrey.schoenbaum@nih.gov
    Competing interests
    The authors declare that no competing interests exist.

Reviewing Editor

  1. Howard Eichenbaum, Boston University, United States

Ethics

Animal experimentation: Rats were tested at the University of Maryland School of Medicine and the NIDA-IRP in accordance with SOM and NIH guidelines (12-CNRB-108).

Version history

  1. Received: February 26, 2014
  2. Accepted: July 17, 2014
  3. Accepted Manuscript published: July 18, 2014 (version 1)
  4. Accepted Manuscript updated: July 20, 2014 (version 2)
  5. Version of Record published: August 14, 2014 (version 3)

Copyright

This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.

Metrics

  • 2,015
    views
  • 193
    downloads
  • 54
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Michael A McDannald
  2. Guillem R Esber
  3. Meredyth A Wegener
  4. Heather M Wied
  5. Tzu-Lan Liu
  6. Thomas A Stalnaker
  7. Joshua L Jones
  8. Jason Trageser
  9. Geoffrey Schoenbaum
(2014)
Orbitofrontal neurons acquire responses to 'valueless' Pavlovian cues during unblocking
eLife 3:e02653.
https://doi.org/10.7554/eLife.02653

Share this article

https://doi.org/10.7554/eLife.02653

Further reading

    1. Neuroscience
    Aviv Ratzon, Dori Derdikman, Omri Barak
    Research Article

    Recent studies show that, even in constant environments, the tuning of single neurons changes over time in a variety of brain regions. This representational drift has been suggested to be a consequence of continuous learning under noise, but its properties are still not fully understood. To investigate the underlying mechanism, we trained an artificial network on a simplified navigational task. The network quickly reached a state of high performance, and many units exhibited spatial tuning. We then continued training the network and noticed that the activity became sparser with time. Initial learning was orders of magnitude faster than ensuing sparsification. This sparsification is consistent with recent results in machine learning, in which networks slowly move within their solution space until they reach a flat area of the loss function. We analyzed four datasets from different labs, all demonstrating that CA1 neurons become sparser and more spatially informative with exposure to the same environment. We conclude that learning is divided into three overlapping phases: (i) Fast familiarity with the environment; (ii) slow implicit regularization; and (iii) a steady state of null drift. The variability in drift dynamics opens the possibility of inferring learning algorithms from observations of drift statistics.