1. Neuroscience
Download icon

Using the past to estimate sensory uncertainty

  1. Ulrik Beierholm  Is a corresponding author
  2. Tim Rohe
  3. Ambra Ferrari
  4. Oliver Stegle
  5. Uta Noppeney
  1. Durham University, United Kingdom
  2. Friedrich Alexander University Erlangen-Nuernberg, Germany
  3. University of Birmingham, United Kingdom
  4. DKFZ, Germany
Research Article
  • Cited 2
  • Views 1,473
  • Annotations
Cite this article as: eLife 2020;9:e54172 doi: 10.7554/eLife.54172

Abstract

To form a more reliable percept of the environment, the brain needs to estimate its own sensory uncertainty. Current theories of perceptual inference assume that the brain computes sensory uncertainty instantaneously and independently for each stimulus. We evaluated this assumption in four psychophysical experiments, in which human observers localized auditory signals that were presented synchronously with spatially disparate visual signals. Critically, the visual noise changed dynamically over time continuously or with intermittent jumps. Our results show that observers integrate audiovisual inputs weighted by sensory uncertainty estimates that combine information from past and current signals consistent with an optimal Bayesian learner that can be approximated by exponential discounting. Our results challenge leading models of perceptual inference where sensory uncertainty estimates depend only on the current stimulus. They demonstrate that the brain capitalizes on the temporal dynamics of the external world and estimates sensory uncertainty by combining past experiences with new incoming sensory signals.

Data availability

The human behavioral raw data and computational model predictions as well as the code for computational modelling and analyses scripts are available in an OSF repository: https://osf.io/gt4jb/

The following data sets were generated

Article and author information

Author details

  1. Ulrik Beierholm

    Psychology Department, Durham University, Durham, United Kingdom
    For correspondence
    ulrik.beierholm@durham.ac.uk
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-7296-7996
  2. Tim Rohe

    Institute of Psychology, Friedrich Alexander University Erlangen-Nuernberg, Erlangen, Germany
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-9713-3712
  3. Ambra Ferrari

    Centre for Computational Neuroscience and Cognitive Robotics, University of Birmingham, Birmingham, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1946-3884
  4. Oliver Stegle

    DKFZ, Heidelberg, Germany
    Competing interests
    The authors declare that no competing interests exist.
  5. Uta Noppeney

    Computational Neuroscience and Cognitive Robotics Centre, University of Birmingham, Birmingham, United Kingdom
    Competing interests
    The authors declare that no competing interests exist.

Funding

H2020 European Research Council (ERC-multsens,309349)

  • Uta Noppeney

Max Planck Society

  • Tim Rohe
  • Uta Noppeney

Deutsche Forschungsgemeinschaft (DFG RO 5587/1-1)

  • Tim Rohe

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: All volunteers participated in the study after giving written informed consent. The study was approved by the human research review committee of the University of Tuebingen (approval number 432 2007 BO1) and the research review committee of the University of Birmingham (approval number ERN_15-1458AP1).

Reviewing Editor

  1. Tobias Reichenbach, Imperial College London, United Kingdom

Publication history

  1. Received: December 4, 2019
  2. Accepted: December 13, 2020
  3. Accepted Manuscript published: December 15, 2020 (version 1)
  4. Version of Record published: January 13, 2021 (version 2)

Copyright

© 2020, Beierholm et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,473
    Page views
  • 240
    Downloads
  • 2
    Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Download citations (links to download the citations from this article in formats compatible with various reference manager tools)

Open citations (links to open the citations from this article in various online reference manager services)

Further reading

    1. Neuroscience
    2. Structural Biology and Molecular Biophysics
    Johannes Elferich et al.
    Research Article Updated

    Mechanosensory transduction (MT), the conversion of mechanical stimuli into electrical signals, underpins hearing and balance and is carried out within hair cells in the inner ear. Hair cells harbor actin-filled stereocilia, arranged in rows of descending heights, where the tips of stereocilia are connected to their taller neighbors by a filament composed of protocadherin 15 (PCDH15) and cadherin 23 (CDH23), deemed the ‘tip link.’ Tension exerted on the tip link opens an ion channel at the tip of the shorter stereocilia, thus converting mechanical force into an electrical signal. While biochemical and structural studies have provided insights into the molecular composition and structure of isolated portions of the tip link, the architecture, location, and conformational states of intact tip links, on stereocilia, remains unknown. Here, we report in situ cryo-electron microscopy imaging of the tip link in mouse stereocilia. We observe individual PCDH15 molecules at the tip and shaft of stereocilia and determine their stoichiometry, conformational heterogeneity, and their complexes with other filamentous proteins, perhaps including CDH23. The PCDH15 complexes occur in clusters, frequently with more than one copy of PCDH15 at the tip of stereocilia, suggesting that tip links might consist of more than one copy of PCDH15 complexes and, by extension, might include multiple MT complexes.

    1. Neuroscience
    Thomas Akam et al.
    Research Article

    Laboratory behavioural tasks are an essential research tool. As questions asked of behaviour and brain activity become more sophisticated, the ability to specify and run richly structured tasks becomes more important. An increasing focus on reproducibility also necessitates accurate communication of task logic to other researchers. To these ends, we developed pyControl, a system of open-source hardware and software for controlling behavioural experiments comprising a simple yet flexible Python-based syntax for specifying tasks as extended state machines, hardware modules for building behavioural setups, and a graphical user interface designed for efficiently running high-throughput experiments on many setups in parallel, all with extensive online documentation. These tools make it quicker, easier, and cheaper to implement rich behavioural tasks at scale. As important, pyControl facilitates communication and reproducibility of behavioural experiments through a highly readable task definition syntax and self-documenting features. Here, we outline the system’s design and rationale, present validation experiments characterising system performance, and demonstrate example applications in freely moving and head-fixed mouse behaviour.