Rat anterior cingulate cortex recalls features of remote reward locations after disfavoured reinforcements

Abstract

The anterior cingulate cortex (ACC) encodes information supporting mnemonic and cognitive processes. We show here that a rat's position can be decoded with high spatiotemporal resolution from ACC activity. ACC neurons encoded the current state of the animal and task, except for brief excursions that sometimes occurred at target feeders. During excursions, the decoded position became more similar to a remote target feeder than the rat's physical position. Excursions recruited activation of neurons encoding choice and reward, and the likelihood of excursions at a feeder was inversely correlated with feeder preference. These data suggest that the excursion phenomenon was related to evaluating real or fictive choice outcomes, particularly after disfavoured reinforcements. We propose that the multiplexing of position with choice-related information forms a mental model isomorphic with the task space, which can be mentally navigated via excursions to recall multimodal information about the utility of remote locations.

Data availability

The pre-processed data used for the paper and the computer codes for the artificial neural network are available for download at a publicly accessible repository (https://github.com/mashhoori/ACC-Recalls-Features-of-Remote-Reward-Locations).

Article and author information

Author details

  1. Ali Mashhoori

    Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Canada
    Competing interests
    The authors declare that no competing interests exist.
  2. Saeedeh Hashemniayetorshizi

    Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Canada
    Competing interests
    The authors declare that no competing interests exist.
  3. Bruce L McNaughton

    Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Canada
    Competing interests
    The authors declare that no competing interests exist.
  4. David Euston

    Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Canada
    Competing interests
    The authors declare that no competing interests exist.
  5. Aaron J Gruber

    Canadian Centre for Behavioural Neuroscience, University of Lethbridge, Lethbridge, Canada
    For correspondence
    aaron.gruber@uleth.ca
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-2700-5429

Funding

Alberta Innovates - Health Solutions

  • Bruce L McNaughton
  • David Euston
  • Aaron J Gruber

Natural Sciences and Engineering Research Council of Canada

  • Saeedeh Hashemniayetorshizi
  • Bruce L McNaughton
  • David Euston
  • Aaron J Gruber

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Reviewing Editor

  1. Timothy E Behrens, University of Oxford, United Kingdom

Ethics

Animal experimentation: All procedures were approved by the university's animal welfare committee (Protocol #1512) in accordance with the Canadian Council on Animal Care.

Version history

  1. Received: June 21, 2017
  2. Accepted: April 4, 2018
  3. Accepted Manuscript published: April 17, 2018 (version 1)
  4. Version of Record published: May 2, 2018 (version 2)
  5. Version of Record updated: September 9, 2021 (version 3)

Copyright

© 2018, Mashhoori et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 3,171
    views
  • 406
    downloads
  • 46
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Ali Mashhoori
  2. Saeedeh Hashemniayetorshizi
  3. Bruce L McNaughton
  4. David Euston
  5. Aaron J Gruber
(2018)
Rat anterior cingulate cortex recalls features of remote reward locations after disfavoured reinforcements
eLife 7:e29793.
https://doi.org/10.7554/eLife.29793

Share this article

https://doi.org/10.7554/eLife.29793

Further reading

    1. Neuroscience
    Olivier Codol, Jonathan A Michaels ... Paul L Gribble
    Tools and Resources

    Artificial neural networks (ANNs) are a powerful class of computational models for unravelling neural mechanisms of brain function. However, for neural control of movement, they currently must be integrated with software simulating biomechanical effectors, leading to limiting impracticalities: (1) researchers must rely on two different platforms and (2) biomechanical effectors are not generally differentiable, constraining researchers to reinforcement learning algorithms despite the existence and potential biological relevance of faster training methods. To address these limitations, we developed MotorNet, an open-source Python toolbox for creating arbitrarily complex, differentiable, and biomechanically realistic effectors that can be trained on user-defined motor tasks using ANNs. MotorNet is designed to meet several goals: ease of installation, ease of use, a high-level user-friendly application programming interface, and a modular architecture to allow for flexibility in model building. MotorNet requires no dependencies outside Python, making it easy to get started with. For instance, it allows training ANNs on typically used motor control models such as a two joint, six muscle, planar arm within minutes on a typical desktop computer. MotorNet is built on PyTorch and therefore can implement any network architecture that is possible using the PyTorch framework. Consequently, it will immediately benefit from advances in artificial intelligence through PyTorch updates. Finally, it is open source, enabling users to create and share their own improvements, such as new effector and network architectures or custom task designs. MotorNet’s focus on higher-order model and task design will alleviate overhead cost to initiate computational projects for new researchers by providing a standalone, ready-to-go framework, and speed up efforts of established computational teams by enabling a focus on concepts and ideas over implementation.

    1. Neuroscience
    Meike E van der Heijden, Amanda M Brown ... Roy V Sillitoe
    Research Article

    The cerebellum contributes to a diverse array of motor conditions, including ataxia, dystonia, and tremor. The neural substrates that encode this diversity are unclear. Here, we tested whether the neural spike activity of cerebellar output neurons is distinct between movement disorders with different impairments, generalizable across movement disorders with similar impairments, and capable of causing distinct movement impairments. Using in vivo awake recordings as input data, we trained a supervised classifier model to differentiate the spike parameters between mouse models for ataxia, dystonia, and tremor. The classifier model correctly assigned mouse phenotypes based on single-neuron signatures. Spike signatures were shared across etiologically distinct but phenotypically similar disease models. Mimicking these pathophysiological spike signatures with optogenetics induced the predicted motor impairments in otherwise healthy mice. These data show that distinct spike signatures promote the behavioral presentation of cerebellar diseases.