1. Computational and Systems Biology
  2. Neuroscience
Download icon

A cholinergic feedback circuitto regulate striatal population uncertainty and optimize reinforcement learning

  1. Nicholas T Franklin
  2. Michael J Frank  Is a corresponding author
  1. Brown University, United States
Research Article
  • Cited 25
  • Views 2,181
  • Annotations
Cite this article as: eLife 2015;4:e12029 doi: 10.7554/eLife.12029

Abstract

Convergent evidence suggeststhat the basal ganglia support reinforcement learning by adjusting action values according to reward prediction errors. However, adaptive behavior in stochasticenvironments requires the consideration of uncertainty to dynamically adjust the learning rate. We consider how cholinergic tonically active interneurons (TANs) may endow the striatum with such a mechanismin computational models spanning three Marr's levels of analysis. In the neural model, TANs modulate the excitability of spiny neurons, theirpopulation response to reinforcement, and hence the effective learning rate. Long TAN pauses facilitated robustness to spuriousoutcomes by increasing divergence in synaptic weights between neurons coding for alternative action values,whereas short TAN pauses facilitated stochastic behavior but increased responsiveness to change-points in outcome contingencies.A feedback control system allowed TAN pauses to be dynamically modulated by uncertainty across the spiny neuron population,allowing the system to self-tune and optimizeperformance across stochastic environments.

Article and author information

Author details

  1. Nicholas T Franklin

    Department of Cognitive, Linguistic and Psychological Sciences, Brown Institute for Brain Science, Brown University, Providence, United States
    Competing interests
    No competing interests declared.
  2. Michael J Frank

    Department of Cognitive, Linguistic and Psychological Sciences, Brown Institute for Brain Science, Brown University, Providence, United States
    For correspondence
    Michael_Frank@brown.edu
    Competing interests
    Michael J Frank, Reviewing editor, eLife.

Reviewing Editor

  1. Upinder S Bhalla, National Centre for Biological Sciences, India

Publication history

  1. Received: October 3, 2015
  2. Accepted: December 24, 2015
  3. Accepted Manuscript published: December 25, 2015 (version 1)
  4. Accepted Manuscript updated: January 12, 2016 (version 2)
  5. Accepted Manuscript updated: January 13, 2016 (version 3)
  6. Version of Record published: February 10, 2016 (version 4)

Copyright

© 2015, Franklin & Frank

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,181
    Page views
  • 460
    Downloads
  • 25
    Citations

Article citation count generated by polling the highest count across the following sources: Crossref, Scopus, PubMed Central.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Download citations (links to download the citations from this article in formats compatible with various reference manager tools)

Open citations (links to open the citations from this article in various online reference manager services)

Further reading

    1. Computational and Systems Biology
    Lucile Megret et al.
    Research Article

    Loss of cellular homeostasis has been implicated in the etiology of several neurodegenerative diseases (NDs). However, the molecular mechanisms that underlie this loss remain poorly understood on a systems level in each case. Here, using a novel computational approach to integrate dimensional RNA-seq and in vivo neuron survival data, we map the temporal dynamics of homeostatic and pathogenic responses in four striatal cell types of Huntington’s disease (HD) model mice. This map shows that most pathogenic responses are mitigated and most homeostatic responses are decreased over time, suggesting that neuronal death in HD is primarily driven by the loss of homeostatic responses. Moreover, different cell types may lose similar homeostatic processes, for example, endosome biogenesis and mitochondrial quality control in Drd1-expressing neurons and astrocytes. HD relevance is validated by human stem cell, genome-wide association study, and post-mortem brain data. These findings provide a new paradigm and framework for therapeutic discovery in HD and other NDs.

    1. Cell Biology
    2. Computational and Systems Biology
    Taraneh Zarin et al.
    Research Advance

    In previous work, we showed that intrinsically disordered regions (IDRs) of proteins contain sequence-distributed molecular features that are conserved over evolution, despite little sequence similarity that can be detected in alignments (Zarin et al. 2019). Here, we aim to use these molecular features to predict specific biological functions for individual IDRs and identify the molecular features within them that are associated with these functions. We find that the predictable functions are diverse. Examining the associated molecular features, we note some that are consistent with previous reports, and identify others that were previously unknown. We experimentally confirm that elevated isoelectric point and hydrophobicity, features that are positively associated with mitochondrial localization, are necessary for mitochondrial targeting function. Remarkably, increasing isoelectric point in a synthetic IDR restores weak mitochondrial targeting. We believe feature analysis represents a new systematic approach to understand how biological functions of IDRs are specified by their protein sequences.