Normative evidence accumulation in unpredictable environments

  1. Christopher M Glaze  Is a corresponding author
  2. Joseph W Kable
  3. Joshua I Gold
  1. University of Pennsylvania, United States
  2. University of Pennsylvania, United Kingdom

Abstract

In our dynamic world, decisions about noisy stimuli can require temporal accumulation of evidence to identify steady signals; differentiation to detect unpredictable changes in those signals; or both. Normative models can account for learning in these environments but have not yet been applied to faster decision processes. We present a novel, normative formulation of adaptive learning models that forms decisions by acting as a leaky accumulator with non-absorbing bounds. These dynamics, derived for both discrete and continuous cases, depend on the expected rate of change of the statistics of the evidence and balance signal identification and change detection. We found that, for two different tasks, human subjects learned these expectations, albeit imperfectly, then used them to make decisions in accordance with the normative model. The results represent a unified, empirically supported account of decision-making in unpredictable environments that provides new insights into the expectation-driven dynamics of the underlying neural signals.

Article and author information

Author details

  1. Christopher M Glaze

    Department of Neuroscience, University of Pennsylvania, Philadelphia, United States
    For correspondence
    cglaze@sas.upenn.edu
    Competing interests
    The authors declare that no competing interests exist.
  2. Joseph W Kable

    Department of Psychology, University of Pennsylvania, Philadelphia, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. Joshua I Gold

    Department of Neuroscience, University of Pennsylvania, University of Pennsylvania, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.

Ethics

Human subjects: Informed consent, and consent to publish, was obtained from each subject prior to each experiment. Human subject protocols were approved by the University of Pennsylvania Internal Review Board.

Reviewing Editor

  1. Timothy Behrens, Oxford University, United Kingdom

Version history

  1. Received: May 19, 2015
  2. Accepted: August 30, 2015
  3. Accepted Manuscript published: August 31, 2015 (version 1)
  4. Version of Record published: September 28, 2015 (version 2)

Copyright

© 2015, Glaze et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 4,066
    Page views
  • 833
    Downloads
  • 89
    Citations

Article citation count generated by polling the highest count across the following sources: Scopus, Crossref, PubMed Central.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Christopher M Glaze
  2. Joseph W Kable
  3. Joshua I Gold
(2015)
Normative evidence accumulation in unpredictable environments
eLife 4:e08825.
https://doi.org/10.7554/eLife.08825

Share this article

https://doi.org/10.7554/eLife.08825

Further reading

    1. Developmental Biology
    2. Neuroscience
    Simon Desiderio, Frederick Schwaller ... Frederic Marmigere
    Research Article

    Touch sensation is primarily encoded by mechanoreceptors, called low-threshold mechanoreceptors (LTMRs), with their cell bodies in the dorsal root ganglia. Because of their great diversity in terms of molecular signature, terminal endings morphology, and electrophysiological properties, mirroring the complexity of tactile experience, LTMRs are a model of choice to study the molecular cues differentially controlling neuronal diversification. While the transcriptional codes that define different LTMR subtypes have been extensively studied, the molecular players that participate in their late maturation and in particular in the striking diversity of their end-organ morphological specialization are largely unknown. Here we identified the TALE homeodomain transcription factor Meis2 as a key regulator of LTMRs target-field innervation in mice. Meis2 is specifically expressed in cutaneous LTMRs, and its expression depends on target-derived signals. While LTMRs lacking Meis2 survived and are normally specified, their end-organ innervations, electrophysiological properties, and transcriptome are differentially and markedly affected, resulting in impaired sensory-evoked behavioral responses. These data establish Meis2 as a major transcriptional regulator controlling the orderly formation of sensory neurons innervating peripheral end organs required for light touch.

    1. Neuroscience
    Maureen van der Grinten, Jaap de Ruyter van Steveninck ... Yağmur Güçlütürk
    Tools and Resources

    Blindness affects millions of people around the world. A promising solution to restoring a form of vision for some individuals are cortical visual prostheses, which bypass part of the impaired visual pathway by converting camera input to electrical stimulation of the visual system. The artificially induced visual percept (a pattern of localized light flashes, or ‘phosphenes’) has limited resolution, and a great portion of the field’s research is devoted to optimizing the efficacy, efficiency, and practical usefulness of the encoding of visual information. A commonly exploited method is non-invasive functional evaluation in sighted subjects or with computational models by using simulated prosthetic vision (SPV) pipelines. An important challenge in this approach is to balance enhanced perceptual realism, biologically plausibility, and real-time performance in the simulation of cortical prosthetic vision. We present a biologically plausible, PyTorch-based phosphene simulator that can run in real-time and uses differentiable operations to allow for gradient-based computational optimization of phosphene encoding models. The simulator integrates a wide range of clinical results with neurophysiological evidence in humans and non-human primates. The pipeline includes a model of the retinotopic organization and cortical magnification of the visual cortex. Moreover, the quantitative effects of stimulation parameters and temporal dynamics on phosphene characteristics are incorporated. Our results demonstrate the simulator’s suitability for both computational applications such as end-to-end deep learning-based prosthetic vision optimization as well as behavioral experiments. The modular and open-source software provides a flexible simulation framework for computational, clinical, and behavioral neuroscientists working on visual neuroprosthetics.